-- Logs begin at Sat 2022-04-16 20:01:17 UTC, end at Sat 2022-04-16 22:37:20 UTC. --
Apr 16 20:57:21.204499 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service.
Apr 16 20:57:24.831219 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=130500) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}}
Apr 16 20:57:24.831880 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=130500) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 16 20:57:25.306741 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_db.sqlalchemy.engines [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Apr 16 20:57:25.538727 ncdv-master-1 cinder-volume[130500]: INFO cinder.rpc [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 16 20:57:25.547218 ncdv-master-1 cinder-volume[130500]: INFO cinder.rpc [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 16 20:57:25.552517 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_db.sqlalchemy.engines [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Apr 16 20:57:25.622113 ncdv-master-1 cinder-volume[130500]: INFO cinder.volume.manager [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] Determined volume DB was empty at startup.
Apr 16 20:57:25.622846 ncdv-master-1 cinder-volume[130500]: DEBUG cinder.volume.manager [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=130500) __init__ /opt/stack/cinder/cinder/volume/manager.py:286}}
Apr 16 20:57:25.630502 ncdv-master-1 cinder-volume[130500]: INFO cinder.volume.manager [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 16 20:57:25.632767 ncdv-master-1 cinder-volume[130500]: WARNING stevedore.named [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 16 20:57:25.632767 ncdv-master-1 cinder-volume[130500]: WARNING castellan.key_manager [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 16 20:57:25.633262 ncdv-master-1 cinder-volume[130500]: WARNING cinder.keymgr.conf_key_mgr [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 16 20:57:25.649533 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_db.sqlalchemy.engines [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Apr 16 20:57:25.654292 ncdv-master-1 cinder-volume[130500]: INFO cinder.rpc [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 16 20:57:25.659169 ncdv-master-1 cinder-volume[130500]: INFO cinder.rpc [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version.
Apr 16 20:57:25.659907 ncdv-master-1 cinder-volume[130500]: WARNING stevedore.named [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 16 20:57:25.660449 ncdv-master-1 cinder-volume[130500]: WARNING castellan.key_manager [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 16 20:57:25.662203 ncdv-master-1 cinder-volume[130500]: INFO cinder.volume.manager [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] Image-volume cache enabled for host ncdv-master-1@ceph.
Apr 16 20:57:25.667249 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_db.sqlalchemy.engines [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Apr 16 20:57:25.790779 ncdv-master-1 cinder-volume[130500]: INFO oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] Starting 1 workers
Apr 16 20:57:25.796697 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] Started child 130674 {{(pid=130500) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}}
Apr 16 20:57:25.810852 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] Full set of CONF: {{(pid=130500) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}}
Apr 16 20:57:25.810852 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ******************************************************************************** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Apr 16 20:57:25.810852 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] Configuration options gathered from: {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Apr 16 20:57:25.810852 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Apr 16 20:57:25.810852 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Apr 16 20:57:25.810852 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ================================================================================ {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Apr 16 20:57:25.811404 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] allow_availability_zone_fallback = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.811404 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] allow_compression_on_image_upload = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.811544 ncdv-master-1 cinder-volume[130674]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0)
Apr 16 20:57:25.812045 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] allowed_direct_url_schemes     = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812045 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] api_rate_limit                 = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812045 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] auth_strategy                  = keystone {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812045 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] az_cache_duration              = 3600 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812045 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_availability_zone      = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812045 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_host                   = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812045 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_name                   = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812523 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_stats_polling_interval = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812523 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backup_api_class               = cinder.backup.api.API {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812523 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812523 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backup_name_template           = backup-%s {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812523 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backup_use_same_host           = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812523 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backup_use_temp_snapshot       = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812917 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] chap_password                  = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812917 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] chap_username                  =  {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812917 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812917 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cinder_internal_tenant_project_id = 4cb034afa3444ac9bfb020f072f6e801 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812917 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cinder_internal_tenant_user_id = 6245e1a1bf6e41fb8660d5f4a3439068 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.812917 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cloned_volume_same_az          = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.813312 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cluster                        = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.814236 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] compression_format             = gzip {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.814874 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] compute_api_class              = cinder.compute.nova.API {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.815506 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] config_dir                     = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.816134 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.816843 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] config_source                  = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.817640 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.818469 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] control_exchange               = openstack {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.819133 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] debug                          = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.835082 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] default_availability_zone      = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.835082 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] default_group_type             = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.835082 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.835082 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] default_volume_type            = ceph {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.835082 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] driver_client_cert             = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.881613 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] driver_client_cert_key         = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.881613 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] driver_data_namespace          = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.881613 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] driver_ssl_cert_path           = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.881613 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] driver_ssl_cert_verify         = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.881613 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] driver_use_ssl                 = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.881613 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] enable_force_upload            = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.881613 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] enable_new_services            = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.882260 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] enable_unsupported_driver      = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.882260 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] enabled_backends               = ['ceph'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.882260 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] enforce_multipath_for_image_xfer = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.882260 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] filter_function                = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.882260 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] glance_api_insecure            = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.882260 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] glance_api_servers             = ['http://10.222.0.20/image'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.882745 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] glance_api_ssl_compression     = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.882745 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] glance_ca_certificates_file    = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.882745 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] glance_catalog_info            = image:glance:publicURL {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883023 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] Starting volume driver RBDDriver (1.2.0)
Apr 16 20:57:25.883023 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 20:57:25.883177 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] glance_certfile                = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883177 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883177 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] glance_keyfile                 = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883177 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] glance_num_retries             = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883177 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] glance_request_timeout         = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883177 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] goodness_function              = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883582 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] graceful_shutdown_timeout      = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883582 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] group_api_class                = cinder.group.api.API {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883582 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] host                           = ncdv-master-1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883582 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] iet_conf                       = /etc/iet/ietd.conf {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883582 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] image_compress_on_upload       = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883582 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] image_conversion_address_space_limit = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883976 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] image_conversion_cpu_limit     = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883976 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883976 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] image_upload_use_cinder_backend = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883976 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] image_upload_use_internal_tenant = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883976 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] image_volume_cache_enabled     = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883976 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] image_volume_cache_max_count   = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.883976 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] image_volume_cache_max_size_gb = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.886525 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] init_host_max_objects_retrieval = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.886525 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] instance_format                = [instance: %(uuid)s]  {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.886525 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.886525 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] iscsi_iotype                   = fileio {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.886525 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] iscsi_secondary_ip_addresses   = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.886525 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] iscsi_target_flags             =  {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.886525 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] iscsi_write_cache              = on {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.887139 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] iser_helper                    = tgtadm {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.887139 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] iser_ip_address                = 10.222.0.20 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.887139 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] iser_port                      = 3260 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.887139 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.887139 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] log_config_append              = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.887139 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.887625 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] log_dir                        = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.887625 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] log_file                       = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.887625 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] log_options                    = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.887625 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] log_rotate_interval            = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.887625 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] log_rotate_interval_type       = days {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.887625 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] log_rotation_type              = none {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.888204 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.888204 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.888204 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.888204 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.888204 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.888700 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] max_age                        = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.888700 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] max_logfile_count              = 30 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.888700 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] max_logfile_size_mb            = 200 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.888700 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] max_over_subscription_ratio    = 20.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.888700 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] message_reap_interval          = 86400 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.888700 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] message_ttl                    = 2592000 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.888700 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] migration_create_volume_timeout_secs = 300 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.889348 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] monkey_patch                   = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.889348 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] monkey_patch_modules           = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.889348 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] my_ip                          = 10.222.0.20 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.889348 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] no_snapshot_gb_quota           = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.889348 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] num_iser_scan_tries            = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.889348 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] num_shell_tries                = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.889348 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] num_volume_device_scan_tries   = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.890034 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] nvmet_ns_id                    = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.890034 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] nvmet_port_id                  = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.890034 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] osapi_max_limit                = 1000 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.890034 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] osapi_volume_ext_list          = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.890034 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.890034 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.890518 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] osapi_volume_listen_port       = 8776 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.890518 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] osapi_volume_use_ssl           = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.890518 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] osapi_volume_workers           = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.890518 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] per_volume_size_limit          = -1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.890518 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] periodic_fuzzy_delay           = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.890518 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] periodic_interval              = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.890518 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.891084 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] public_endpoint                = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.891084 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] publish_errors                 = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.891084 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] quota_backup_gigabytes         = 1000 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.891084 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] quota_backups                  = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.891084 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] quota_consistencygroups        = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.891084 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.891084 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] quota_gigabytes                = 1000 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.915711 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] quota_groups                   = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.915711 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] quota_snapshots                = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.915711 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] quota_volumes                  = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.915711 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] rate_limit_burst               = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.915711 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] rate_limit_except_level        = CRITICAL {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.915711 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] rate_limit_interval            = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.915711 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] reinit_driver_count            = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.916338 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] replication_device             = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.916338 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] report_discard_supported       = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.916338 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] report_interval                = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.916338 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] reservation_clean_interval     = 86400 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.916338 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] reservation_expire             = 86400 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.916338 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] reserved_percentage            = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.916338 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.916884 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.916884 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] rpc_response_timeout           = 120 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.916884 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] run_external_periodic_tasks    = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.916884 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.916884 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] scst_target_driver             = iscsi {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.916884 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] scst_target_iqn_name           = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.917443 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] service_down_time              = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.917443 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] snapshot_name_template         = snapshot-%s {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.917443 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] snapshot_same_host             = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.917443 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] split_loggers                  = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.917443 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] state_path                     = /opt/stack/data/cinder {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.917443 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] storage_availability_zone      = nova {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.917443 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] storage_protocol               = iscsi {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.918548 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] syslog_log_facility            = LOG_USER {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.918548 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] target_helper                  = lioadm {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.918548 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] target_ip_address              = 10.222.0.20 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.918548 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] target_port                    = 3260 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.918548 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.918548 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] target_protocol                = iscsi {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.919018 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] trace_flags                    = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.919018 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.919018 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] transport_url                  = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.919018 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] until_refresh                  = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.919018 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] use_chap_auth                  = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.919018 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] use_default_quota_class        = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.919018 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] use_eventlog                   = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.919585 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] use_journal                    = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.919585 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] use_json                       = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.919585 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] use_multipath_for_image_xfer   = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.919585 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] use_stderr                     = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.919585 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] use_syslog                     = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.919585 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] verify_glance_signatures       = enabled {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.919585 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] volume_api_class               = cinder.volume.api.API {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.920124 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] volume_backend_name            = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.920124 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] volume_clear                   = zero {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.920124 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] volume_clear_ionice            = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.920124 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] volume_clear_size              = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.920124 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.920124 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] volume_copy_bps_limit          = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.920124 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] volume_dd_blocksize            = 1M {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.920729 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.920729 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] volume_name_template           = volume-%s {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.920911 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 20:57:25.921009 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] volume_service_inithost_offload = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.921009 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] volume_usage_audit_period      = month {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.921009 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.921009 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] watch_log_file                 = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.921009 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] zoning_mode                    = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 16 20:57:25.921009 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.921825 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.921825 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_policy.enforce_new_defaults = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.921825 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_policy.enforce_scope      = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.921825 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_policy.policy_default_rule = default {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.921825 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.921825 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_policy.policy_file        = policy.yaml {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.922319 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.922319 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.922319 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.922319 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.922319 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.922319 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_concurrency.disable_process_locking = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.922785 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.922785 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.admin_password = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.922785 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.922785 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.admin_token = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.922785 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.admin_user  = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.922785 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.923309 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.923309 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.auth_port   = 35357 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.923309 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.auth_protocol = https {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.923309 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.auth_section = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.923309 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.auth_type   = password {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.923309 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.auth_uri    = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.923309 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.auth_version = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.923871 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.cache       = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.923871 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.923871 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.certfile    = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.923871 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.delay_auth_decision = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.923871 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.923871 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.http_connect_timeout = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.924370 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.924370 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.identity_uri = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.924370 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.include_service_catalog = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.924370 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.insecure    = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.924370 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.interface   = public {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.924370 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.keyfile     = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.924810 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.924810 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.924810 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.924810 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.924810 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.924810 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.925356 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.925356 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.925356 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.925356 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.region_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.925356 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.925356 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.service_token_roles_required = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.925817 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.service_type = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.925817 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.token_cache_time = 300 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.925817 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.925817 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.backend                  = dogpile.cache.null {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.925817 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.backend_argument         = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.925817 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.config_prefix            = cache.oslo {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.926247 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.dead_timeout             = 60.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.926247 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.debug_cache_backend      = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.929685 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.enable_retry_client      = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.929685 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.enable_socket_keepalive  = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.929685 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.enabled                  = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.929685 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.expiration_time          = 600 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.930065 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.hashclient_retry_attempts = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.930263 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.931538 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.memcache_dead_retry      = 300 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.931920 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.940292 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.940292 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.memcache_pool_maxsize    = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.940292 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.940292 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.940292 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.940292 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.proxies                  = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.940292 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.retry_attempts           = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.941546 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.retry_delay              = 0.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.941546 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.socket_keepalive_count   = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.941546 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.socket_keepalive_idle    = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.941546 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.socket_keepalive_interval = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.941546 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.tls_allowed_ciphers      = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.941546 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.tls_cafile               = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.941546 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.tls_certfile             = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.942022 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.tls_enabled              = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.942022 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cache.tls_keyfile              = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.942022 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] coordination.backend_url       = etcd3+http://10.222.0.20:2379 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.942022 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.backend               = sqlalchemy {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.942022 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.connection            = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.942022 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.connection_debug      = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.942022 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.connection_parameters =  {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.942507 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.connection_recycle_time = 3600 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.942507 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.connection_trace      = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.942507 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.db_inc_retry_interval = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.942507 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.db_max_retries        = 20 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.942507 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.db_max_retry_interval = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.942507 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.db_retry_interval     = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.942901 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.max_overflow          = 50 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.943172 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.max_pool_size         = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.944488 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.max_retries           = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.945086 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.mysql_enable_ndb      = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.945621 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.946130 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.pool_timeout          = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.946649 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.retry_interval        = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.947088 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 20:57:25.947335 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.slave_connection      = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.947848 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.sqlite_synchronous    = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.948378 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] database.use_db_reconnect      = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.948933 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.950050 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.950583 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.951122 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.951627 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.952256 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] profiler.connection_string     = messaging:// {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.952717 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] profiler.enabled               = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.953264 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] profiler.es_doc_type           = notification {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.953771 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] profiler.es_scroll_size        = 10000 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.954304 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] profiler.es_scroll_time        = 2m {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.954858 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] profiler.filter_error_trace    = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.955401 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.955942 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] profiler.sentinel_service_name = mymaster {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.956499 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] profiler.socket_timeout        = 0.1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.957039 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] profiler.trace_sqlalchemy      = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.957611 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] privsep_osbrick.capabilities   = [21] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.958176 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] privsep_osbrick.group          = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.958685 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] privsep_osbrick.helper_command = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.959208 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] privsep_osbrick.logger_name    = oslo_privsep.daemon {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.959729 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.960104 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] privsep_osbrick.user           = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.960558 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.960914 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cinder_sys_admin.group         = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.961323 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cinder_sys_admin.helper_command = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.961687 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.962071 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.962422 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] cinder_sys_admin.user          = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.962794 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] service_user.auth_section      = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.963168 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] service_user.auth_type         = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.963517 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] service_user.cafile            = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.963889 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] service_user.certfile          = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.964299 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] service_user.collect_timing    = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.964716 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] service_user.insecure          = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.965063 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] service_user.keyfile           = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.965435 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] service_user.send_service_user_token = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.965782 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] service_user.split_loggers     = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.966153 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] service_user.timeout           = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.966558 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.backend_availability_zone = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.966932 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.967317 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.967723 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.chap_password = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.968083 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.chap_username =  {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.968556 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.968927 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.969298 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.969646 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.driver_client_cert = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.970032 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.driver_client_cert_key = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.970377 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.driver_data_namespace = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.970736 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.971122 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.971438 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.driver_use_ssl = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.971786 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.enable_deferred_deletion = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.972129 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.enable_unsupported_driver = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.972523 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.972886 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.extra_capabilities = {} {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.973232 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.filter_function = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.973573 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.goodness_function = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.973933 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.iet_conf      = /etc/iet/ietd.conf {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.974305 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.974650 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.975000 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.975336 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.975689 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.976048 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.977948 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.978684 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.iscsi_target_flags =  {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.979251 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.iscsi_write_cache = on {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.979635 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.iser_helper   = tgtadm {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.980215 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.iser_ip_address = 10.222.0.20 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.980722 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.iser_port     = 3260 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.981100 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.981482 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.981841 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.982195 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.num_shell_tries = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.982552 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.982903 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.983253 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.nvmet_port_id = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.983901 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.984382 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.rados_connection_interval = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.984748 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.rados_connection_retries = 3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.985192 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.rbd_ceph_conf =  {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.985703 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.986057 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.986437 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.986905 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.987475 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.rbd_pool      = rbd {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.987782 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.rbd_secret_uuid = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.988123 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.988491 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.rbd_user      = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.988854 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.989240 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.replication_device = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.989527 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.report_discard_supported = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.989879 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.990404 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.reserved_percentage = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.990609 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.scst_target_driver = iscsi {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.990968 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.scst_target_iqn_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.991351 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.storage_protocol = iscsi {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.991696 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.992058 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.target_helper = tgtadm {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.992578 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.target_ip_address = 10.222.0.20 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.993094 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.target_port   = 3260 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.993458 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.993841 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.target_protocol = iscsi {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.994186 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.trace_flags   = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.994531 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.unique_fqdn_network = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.994880 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.use_chap_auth = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.995226 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.995579 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.volume_backend_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.996470 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.volume_clear  = zero {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.996820 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.volume_clear_ionice = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.997184 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.volume_clear_size = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.997546 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.997898 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.998282 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.998644 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.999137 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.999531 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_reports.file_event_handler = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:25.999917 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.000592 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_reports.log_dir           = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.000984 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.backend_availability_zone = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.001491 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.backend_host              = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.002544 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.backend_native_threads_pool_size = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.003668 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.backup_use_temp_snapshot  = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.004201 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.chap_password             = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.004797 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.chap_username             = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.005320 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.chiscsi_conf              = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.005851 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.deferred_deletion_delay   = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.006212 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.deferred_deletion_purge_interval = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.006586 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.driver_client_cert        = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.006938 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.driver_client_cert_key    = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.007286 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.driver_data_namespace     = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.007634 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.driver_ssl_cert_path      = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.007981 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.driver_ssl_cert_verify    = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.008630 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.driver_use_ssl            = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.009285 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.enable_deferred_deletion  = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.009986 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.enable_unsupported_driver = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.010490 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.010996 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.extra_capabilities        = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.011646 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.filter_function           = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.012657 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.goodness_function         = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.013156 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.iet_conf                  = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.013674 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.image_upload_use_cinder_backend = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.014169 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.image_upload_use_internal_tenant = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.014528 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.driver [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] Driver hasn't implemented _init_vendor_properties()
Apr 16 20:57:26.014854 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.image_volume_cache_enabled = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.015094 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.driver [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:ede3d8f1-0842-4fe6-bb98-99ca97eaad35:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=130674) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:811}}
Apr 16 20:57:26.015543 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.image_volume_cache_max_count = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.016049 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.image_volume_cache_max_size_gb = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.016561 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.iscsi_iotype              = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.017065 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.017576 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.iscsi_target_flags        = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.018080 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.iscsi_write_cache         = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.018583 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.iser_helper               = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.019088 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.iser_ip_address           = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.019589 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.iser_port                 = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.020085 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.iser_target_prefix        = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.020624 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.max_over_subscription_ratio = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.021117 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.num_iser_scan_tries       = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.021623 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.num_shell_tries           = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.022127 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.num_volume_device_scan_tries = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.022617 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.nvmet_ns_id               = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.023126 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.nvmet_port_id             = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.023643 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.rados_connect_timeout     = -1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.024144 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.rados_connection_interval = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.033500 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.rados_connection_retries  = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.033500 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.rbd_ceph_conf             = /etc/ceph/ceph.conf {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.033500 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.rbd_cluster_name          = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.033500 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.033500 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.033500 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.rbd_max_clone_depth       = 5 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.033500 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.rbd_pool                  = volumes {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.034110 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.rbd_secret_uuid           = 10a8cab7-4487-40c7-abcb-c5cebe867304 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.034110 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.rbd_store_chunk_size      = 4 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.034110 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.rbd_user                  = cinder {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.034110 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.replication_connect_timeout = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.034110 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.replication_device        = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.034110 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.report_discard_supported  = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.034664 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.report_dynamic_total_capacity = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.034664 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.reserved_percentage       = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.034664 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.scst_target_driver        = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.034936 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_db.sqlalchemy.engines [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Apr 16 20:57:26.035033 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.scst_target_iqn_name      = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.035033 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.storage_protocol          = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.035033 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.suppress_requests_ssl_warnings = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.035033 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.target_helper             = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.035033 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.target_ip_address         = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.035033 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.target_port               = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.035033 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.target_prefix             = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.035567 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.target_protocol           = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.036031 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.trace_flags               = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.036564 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.unique_fqdn_network       = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.037081 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.use_chap_auth             = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.037592 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.use_multipath_for_image_xfer = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.038137 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.volume_backend_name       = ceph {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.038813 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.volume_clear              = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.039337 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.volume_clear_ionice       = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.039868 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.volume_clear_size         = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.040388 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.040976 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.volume_copy_bps_limit     = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.041496 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.volume_dd_blocksize       = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.042041 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.volume_driver             = cinder.volume.drivers.rbd.RBDDriver {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.042551 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ceph.volumes_dir               = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.043170 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.043757 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.044329 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.044846 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.045389 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.045887 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.046422 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.046942 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.047439 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.047959 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.048366 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.048864 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.049398 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.049989 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.050537 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.051069 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.051889 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.052408 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.052917 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.053403 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.053909 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.054404 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.054947 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.ssl      = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.055505 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.056038 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.056586 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.057111 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.057601 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_notifications.driver = [] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.058139 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_notifications.retry = -1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.059271 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.059827 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] oslo_messaging_notifications.transport_url = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.060351 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.060808 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] key_manager.fixed_key          = **** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.061400 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.061911 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican.barbican_api_version  = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.062427 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican.barbican_endpoint     = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.062990 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican.barbican_endpoint_type = public {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.063493 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican.barbican_region_name  = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.064010 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican.cafile                = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.064580 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican.certfile              = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.065134 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican.collect_timing        = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.065676 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican.insecure              = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.066208 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican.keyfile               = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.066771 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican.number_of_retries     = 60 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.067319 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican.retry_delay           = 1 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.067862 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican.send_service_user_token = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.068452 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican.split_loggers         = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.069039 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican.timeout               = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.069599 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican.verify_ssl            = True {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.070156 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican.verify_ssl_path       = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.070569 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican_service_user.auth_section = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.070987 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican_service_user.auth_type = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.071371 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican_service_user.cafile   = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.071756 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican_service_user.certfile = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.072145 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican_service_user.collect_timing = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.072550 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican_service_user.insecure = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.072929 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican_service_user.keyfile  = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.073312 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican_service_user.split_loggers = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.073694 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] barbican_service_user.timeout  = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.074723 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] vault.approle_role_id          = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.075104 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] vault.approle_secret_id        = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.075653 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] vault.cafile                   = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.076204 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] vault.certfile                 = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.076780 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] vault.collect_timing           = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.077314 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] vault.insecure                 = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.077853 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] vault.keyfile                  = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.078435 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] vault.kv_mountpoint            = secret {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.078976 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] vault.kv_version               = 2 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.079503 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] vault.namespace                = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.080032 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] vault.root_token_id            = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.080584 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] vault.split_loggers            = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.081124 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] vault.ssl_ca_crt_file          = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.081662 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] vault.timeout                  = None {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.082218 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] vault.use_ssl                  = False {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.082771 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 16 20:57:26.083232 ncdv-master-1 cinder-volume[130500]: DEBUG oslo_service.service [None req-04f7f6e4-a59b-4420-984c-b2156eedb634 None None] ******************************************************************************** {{(pid=130500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Apr 16 20:57:26.087530 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.db.sqlalchemy.api [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] Building query based on filter {{(pid=130674) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3377}}
Apr 16 20:57:26.108738 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.image_utils [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=130674) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}}
Apr 16 20:57:26.119056 ncdv-master-1 cinder-volume[130674]: INFO cinder.keymgr.migration [None req-3be2f410-c462-464a-9d29-bc63b07fc17f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 16 20:57:26.123729 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 20:57:26.234633 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 20:57:26.318363 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 20:57:26.346165 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] Driver initialization completed successfully.
Apr 16 20:57:26.356827 ncdv-master-1 cinder-volume[130674]: INFO cinder.manager [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] Initiating service 3 cleanup
Apr 16 20:57:26.363239 ncdv-master-1 cinder-volume[130674]: INFO cinder.manager [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] Service 3 cleanup completed.
Apr 16 20:57:26.363724 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.service [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] Creating RPC server for service cinder-volume {{(pid=130674) start /opt/stack/cinder/cinder/service.py:231}}
Apr 16 20:57:26.378020 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.service [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=130674) start /opt/stack/cinder/cinder/service.py:237}}
Apr 16 20:57:26.434508 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0)
Apr 16 20:57:26.435674 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 20:57:26.461486 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 20:57:26.587150 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4ababde6-ae1e-40fa-82bb-32679068d19d None None] Driver post RPC initialization completed successfully.
Apr 16 20:59:22.589955 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 20:59:22.590814 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 20:59:22.612988 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 20:59:22.636121 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:00:22.591680 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:00:22.592395 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:00:22.613976 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:00:22.640549 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:01:22.595979 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:01:22.596714 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:01:22.618956 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:01:22.641843 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:02:22.596554 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:02:22.597249 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:02:22.618103 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:02:22.640924 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:03:22.595587 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:03:22.596293 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:03:22.618013 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:03:22.638633 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:04:22.593702 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:04:22.594407 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:04:22.614790 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:04:22.635366 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:05:22.590451 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:05:22.591155 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:05:22.693529 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:05:22.715979 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:06:22.591411 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:06:22.592112 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:06:22.625233 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:06:22.651335 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:07:22.587755 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:07:22.589792 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:07:22.663603 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:07:22.792720 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:08:22.591163 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:08:22.592284 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:08:22.634640 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:08:22.662703 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:09:22.592114 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:09:22.592866 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:09:22.654780 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:09:22.775951 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:10:13.325803 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:10:13.373736 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Flow 'volume_create_manager' (ba4d7333-108a-40a7-9082-392a38d013d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:10:13.380822 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af65f57-1960-44b0-8ffd-bc268d3b8dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:10:13.435725 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af65f57-1960-44b0-8ffd-bc268d3b8dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-614091969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a0bbd6c4-67eb-4f42-a9e2-e08052fd877f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68af3300a0d149adbbf934b4ff1f87d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:10:13Z,use_quota=True,user_id='53d5464685cc40d9a1d891c6ae39a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:10:13.441412 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3a08fc-a345-4115-b877-c20fc87b6acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:10:13.445502 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3a08fc-a345-4115-b877-c20fc87b6acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:10:13.450381 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8647aff-38eb-4945-ab2b-ac5121b13ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:10:13.455640 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8647aff-38eb-4945-ab2b-ac5121b13ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0bbd6c4-67eb-4f42-a9e2-e08052fd877f', 'volume_name': 'volume-a0bbd6c4-67eb-4f42-a9e2-e08052fd877f', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:10:13.461388 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682dcd85-a848-4337-afd7-a3fbcc8f3bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:10:13.465954 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682dcd85-a848-4337-afd7-a3fbcc8f3bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:10:13.470973 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec548d7-b8a0-4436-84e8-9c550c36ec2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:10:13.472675 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Volume a0bbd6c4-67eb-4f42-a9e2-e08052fd877f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0bbd6c4-67eb-4f42-a9e2-e08052fd877f', 'volume_size': 1}
Apr 16 21:10:13.473346 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] creating volume 'volume-a0bbd6c4-67eb-4f42-a9e2-e08052fd877f' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:10:13.474377 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:10:14.235767 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:10:14.236417 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:10:14.241345 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec548d7-b8a0-4436-84e8-9c550c36ec2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0bbd6c4-67eb-4f42-a9e2-e08052fd877f', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:10:14.246125 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348404a6-a757-4873-8662-a6d26bb42dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:10:14.376038 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Volume volume-a0bbd6c4-67eb-4f42-a9e2-e08052fd877f (a0bbd6c4-67eb-4f42-a9e2-e08052fd877f): created successfully
Apr 16 21:10:14.387996 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348404a6-a757-4873-8662-a6d26bb42dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:10:14.394567 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Flow 'volume_create_manager' (ba4d7333-108a-40a7-9082-392a38d013d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:10:14.542037 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7c8fcb90-5da2-4d47-baae-927982e3f63d tempest-LiveAutoBlockMigrationV225Test-566463733 None] Created volume successfully.
Apr 16 21:10:19.668307 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-37fb6ab9-73f5-4783-9296-349d59358ba9 req-58e57654-fdab-441d-95e9-7079cc03b34f tempest-LiveAutoBlockMigrationV225Test-566463733 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:10:20.560751 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-37fb6ab9-73f5-4783-9296-349d59358ba9 req-58e57654-fdab-441d-95e9-7079cc03b34f tempest-LiveAutoBlockMigrationV225Test-566463733 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.911s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:10:20.562018 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-37fb6ab9-73f5-4783-9296-349d59358ba9 req-58e57654-fdab-441d-95e9-7079cc03b34f tempest-LiveAutoBlockMigrationV225Test-566463733 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a0bbd6c4-67eb-4f42-a9e2-e08052fd877f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'a0bbd6c4-67eb-4f42-a9e2-e08052fd877f', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:10:20.769562 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-37fb6ab9-73f5-4783-9296-349d59358ba9 req-58e57654-fdab-441d-95e9-7079cc03b34f tempest-LiveAutoBlockMigrationV225Test-566463733 None] Connection info returned from driver {'name': 'volumes/volume-a0bbd6c4-67eb-4f42-a9e2-e08052fd877f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a0bbd6c4-67eb-4f42-a9e2-e08052fd877f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '93f09e44-bfc6-4915-b200-7154f3965665'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:10:21.011154 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-37fb6ab9-73f5-4783-9296-349d59358ba9 req-58e57654-fdab-441d-95e9-7079cc03b34f tempest-LiveAutoBlockMigrationV225Test-566463733 None] attachment_update completed successfully.
Apr 16 21:10:22.597748 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:10:22.599093 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:10:22.673108 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:10:22.730834 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:10:40.221518 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def req-d53ac5b8-d64f-458c-9044-96401f33cc90 tempest-LiveAutoBlockMigrationV225Test-809890570 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:10:41.844757 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def req-d53ac5b8-d64f-458c-9044-96401f33cc90 tempest-LiveAutoBlockMigrationV225Test-809890570 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.621s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:10:41.846650 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def req-d53ac5b8-d64f-458c-9044-96401f33cc90 tempest-LiveAutoBlockMigrationV225Test-809890570 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a0bbd6c4-67eb-4f42-a9e2-e08052fd877f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'a0bbd6c4-67eb-4f42-a9e2-e08052fd877f', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:10:42.004830 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def req-d53ac5b8-d64f-458c-9044-96401f33cc90 tempest-LiveAutoBlockMigrationV225Test-809890570 None] Connection info returned from driver {'name': 'volumes/volume-a0bbd6c4-67eb-4f42-a9e2-e08052fd877f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a0bbd6c4-67eb-4f42-a9e2-e08052fd877f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '357ff8f8-c329-4b83-94b0-292ebf32d8ce'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:10:42.303518 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def req-d53ac5b8-d64f-458c-9044-96401f33cc90 tempest-LiveAutoBlockMigrationV225Test-809890570 None] attachment_update completed successfully.
Apr 16 21:10:43.678744 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:10:43.732940 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Flow 'volume_create_manager' (9c06837c-a959-4c88-ab91-91b5f67536a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:10:43.770091 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67fe4c58-e194-45f0-b722-cf09ac55c69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:10:43.810434 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67fe4c58-e194-45f0-b722-cf09ac55c69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-2126339374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=47811ce7-10e6-4421-b54d-89b4bcfc2df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b18530cc69c44e6f8a46ca966b3e3a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:10:43Z,use_quota=True,user_id='547d9f3aa3a54867971074b795d83b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:10:43.820208 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166304d0-36f5-4fce-9bad-0c85e2463ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:10:43.826322 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166304d0-36f5-4fce-9bad-0c85e2463ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:10:43.838029 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c608e9e4-c496-4c52-affc-8bad6587aa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:10:43.841983 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c608e9e4-c496-4c52-affc-8bad6587aa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47811ce7-10e6-4421-b54d-89b4bcfc2df7', 'volume_name': 'volume-47811ce7-10e6-4421-b54d-89b4bcfc2df7', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:10:43.849625 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124c32e8-f5db-434a-b8b8-81d41959d9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:10:43.854716 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124c32e8-f5db-434a-b8b8-81d41959d9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:10:43.861223 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4979ad93-3061-4efe-9759-63e2ec36909c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:10:43.862628 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Volume 47811ce7-10e6-4421-b54d-89b4bcfc2df7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47811ce7-10e6-4421-b54d-89b4bcfc2df7', 'volume_size': 1}
Apr 16 21:10:43.863233 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] creating volume 'volume-47811ce7-10e6-4421-b54d-89b4bcfc2df7' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:10:43.864131 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:10:44.847539 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:10:44.848163 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:10:44.852143 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4979ad93-3061-4efe-9759-63e2ec36909c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47811ce7-10e6-4421-b54d-89b4bcfc2df7', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:10:44.857052 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24cb3d46-e392-48a8-b5d5-ad3dec5bef07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:10:44.922417 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Volume volume-47811ce7-10e6-4421-b54d-89b4bcfc2df7 (47811ce7-10e6-4421-b54d-89b4bcfc2df7): created successfully
Apr 16 21:10:44.926683 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24cb3d46-e392-48a8-b5d5-ad3dec5bef07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:10:44.933467 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Flow 'volume_create_manager' (9c06837c-a959-4c88-ab91-91b5f67536a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:10:45.018459 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c43a1414-9f6c-49c8-96e3-4d387806d656 tempest-LiveMigrationTest-386991981 None] Created volume successfully.
Apr 16 21:10:48.287710 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-bc58093a-204d-450d-aafd-e2c98864671f req-6d87d570-20a9-4b67-99d6-fb9f836b2698 tempest-LiveMigrationTest-386991981 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:10:49.368448 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-bc58093a-204d-450d-aafd-e2c98864671f req-6d87d570-20a9-4b67-99d6-fb9f836b2698 tempest-LiveMigrationTest-386991981 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.080s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:10:49.369263 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-bc58093a-204d-450d-aafd-e2c98864671f req-6d87d570-20a9-4b67-99d6-fb9f836b2698 tempest-LiveMigrationTest-386991981 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-47811ce7-10e6-4421-b54d-89b4bcfc2df7', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '47811ce7-10e6-4421-b54d-89b4bcfc2df7', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:10:49.535829 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-bc58093a-204d-450d-aafd-e2c98864671f req-6d87d570-20a9-4b67-99d6-fb9f836b2698 tempest-LiveMigrationTest-386991981 None] Connection info returned from driver {'name': 'volumes/volume-47811ce7-10e6-4421-b54d-89b4bcfc2df7', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '47811ce7-10e6-4421-b54d-89b4bcfc2df7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f8244b36-07e3-4514-a60b-2cb5b7289944'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:10:49.705492 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-bc58093a-204d-450d-aafd-e2c98864671f req-6d87d570-20a9-4b67-99d6-fb9f836b2698 tempest-LiveMigrationTest-386991981 None] attachment_update completed successfully.
Apr 16 21:11:02.252653 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def req-46d8b7b7-c686-4f43-9e3a-bfb3c4246afa tempest-LiveAutoBlockMigrationV225Test-809890570 None] Terminate volume connection completed successfully.
Apr 16 21:11:02.253246 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def req-46d8b7b7-c686-4f43-9e3a-bfb3c4246afa tempest-LiveAutoBlockMigrationV225Test-809890570 None] Deleting attachment 93f09e44-bfc6-4915-b200-7154f3965665. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:11:13.837253 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-ee3e0f03-2f96-4c3f-95a2-4ffdce94b020 req-c22cb9b5-9fb6-4b19-ad3c-b126f47ddf53 tempest-LiveAutoBlockMigrationV225Test-566463733 None] Terminate volume connection completed successfully.
Apr 16 21:11:13.838400 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-ee3e0f03-2f96-4c3f-95a2-4ffdce94b020 req-c22cb9b5-9fb6-4b19-ad3c-b126f47ddf53 tempest-LiveAutoBlockMigrationV225Test-566463733 None] Deleting attachment 357ff8f8-c329-4b83-94b0-292ebf32d8ce. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:11:17.528858 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:11:17.611916 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Flow 'volume_create_manager' (62dbd741-5bd2-4b39-ab04-f6ec75d66651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:11:17.620037 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc8a407-8c1b-44d5-a83d-a3f92de64a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:11:17.640874 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc8a407-8c1b-44d5-a83d-a3f92de64a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-305091184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=548a92a5-efad-482f-97c9-7684e6c4b453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68af3300a0d149adbbf934b4ff1f87d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:11:17Z,use_quota=True,user_id='53d5464685cc40d9a1d891c6ae39a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:11:17.650888 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c09345-3393-4fcd-ae13-fe1a4e2acaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:11:17.655754 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c09345-3393-4fcd-ae13-fe1a4e2acaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:11:17.665842 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4d8e0a-3b87-47c6-9bd1-7aa65d903ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:11:17.931564 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4d8e0a-3b87-47c6-9bd1-7aa65d903ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '548a92a5-efad-482f-97c9-7684e6c4b453', 'volume_name': 'volume-548a92a5-efad-482f-97c9-7684e6c4b453', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7126e7460>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:11:17.949109 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e640192-044b-4cfc-8b7c-c74b91ba4d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:11:17.956823 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e640192-044b-4cfc-8b7c-c74b91ba4d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:11:17.965630 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bccdca3-aef5-4627-9d49-f493d7d512dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:11:17.965630 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Volume 548a92a5-efad-482f-97c9-7684e6c4b453: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-548a92a5-efad-482f-97c9-7684e6c4b453', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7126e7460>}
Apr 16 21:11:17.965979 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Cloning 548a92a5-efad-482f-97c9-7684e6c4b453 from image 88bbe9a7-19d2-4102-9634-058b7c590848  at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 16 21:11:17.977193 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:11:17.995992 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Preparing cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:879}}
Apr 16 21:11:18.008536 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Attempting to retrieve cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 16 21:11:19.695225 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d req-2967a001-a51b-42c5-9f62-a2e5ff776005 tempest-LiveMigrationTest-2010750960 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:11:20.722826 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d req-2967a001-a51b-42c5-9f62-a2e5ff776005 tempest-LiveMigrationTest-2010750960 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.027s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:11:20.723786 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d req-2967a001-a51b-42c5-9f62-a2e5ff776005 tempest-LiveMigrationTest-2010750960 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-47811ce7-10e6-4421-b54d-89b4bcfc2df7', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '47811ce7-10e6-4421-b54d-89b4bcfc2df7', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:11:20.847677 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d req-2967a001-a51b-42c5-9f62-a2e5ff776005 tempest-LiveMigrationTest-2010750960 None] Connection info returned from driver {'name': 'volumes/volume-47811ce7-10e6-4421-b54d-89b4bcfc2df7', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '47811ce7-10e6-4421-b54d-89b4bcfc2df7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5ccc9fd2-2929-4ded-b172-e2631bfae78b'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:11:21.008777 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d req-2967a001-a51b-42c5-9f62-a2e5ff776005 tempest-LiveMigrationTest-2010750960 None] attachment_update completed successfully.
Apr 16 21:11:22.599734 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:11:22.600834 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:11:22.655535 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:11:22.705885 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:11:37.993118 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.image_utils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_88bbe9a7-19d2-4102-9634-058b7c590848_owjihsdvncdv-master-1@ceph, size 616.00 MB, duration 19.97 sec {{(pid=130674) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}}
Apr 16 21:11:37.993779 ncdv-master-1 cinder-volume[130674]: INFO cinder.image.image_utils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Image download 616.00 MB at 30.84 MB/s
Apr 16 21:11:38.033041 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_88bbe9a7-19d2-4102-9634-058b7c590848_owjihsdvncdv-master-1@ceph {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:11:38.235840 ncdv-master-1 sudo[141468]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_88bbe9a7-19d2-4102-9634-058b7c590848_owjihsdvncdv-master-1@ceph
Apr 16 21:11:38.236771 ncdv-master-1 sudo[141468]: pam_unix(sudo:session): session opened for user root by (uid=0)
Apr 16 21:11:38.831639 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d req-e9a8c5c5-ebe3-4e3f-a1b6-a2298f52226e tempest-LiveMigrationTest-2010750960 None] Terminate volume connection completed successfully.
Apr 16 21:11:38.835138 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d req-e9a8c5c5-ebe3-4e3f-a1b6-a2298f52226e tempest-LiveMigrationTest-2010750960 None] Deleting attachment f8244b36-07e3-4514-a60b-2cb5b7289944. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:11:40.795612 ncdv-master-1 sudo[141468]: pam_unix(sudo:session): session closed for user root
Apr 16 21:11:40.803642 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_88bbe9a7-19d2-4102-9634-058b7c590848_owjihsdvncdv-master-1@ceph" returned: 0 in 2.766s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:11:40.806254 ncdv-master-1 cinder-volume[130674]: WARNING py.warnings [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena'
Apr 16 21:11:40.806254 ncdv-master-1 cinder-volume[130674]:   debtcollector.deprecate(
Apr 16 21:11:40.806254 ncdv-master-1 cinder-volume[130674]: 
Apr 16 21:11:40.807204 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.image_utils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Temporary image 88bbe9a7-19d2-4102-9634-058b7c590848 is fetched for user 53d5464685cc40d9a1d891c6ae39a80f. {{(pid=130674) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Apr 16 21:11:41.010044 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_88bbe9a7-19d2-4102-9634-058b7c590848_owjihsdvncdv-master-1@ceph {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:11:41.199785 ncdv-master-1 sudo[141476]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_88bbe9a7-19d2-4102-9634-058b7c590848_owjihsdvncdv-master-1@ceph
Apr 16 21:11:41.200612 ncdv-master-1 sudo[141476]: pam_unix(sudo:session): session opened for user root by (uid=0)
Apr 16 21:11:43.186232 ncdv-master-1 sudo[141476]: pam_unix(sudo:session): session closed for user root
Apr 16 21:11:43.201766 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_88bbe9a7-19d2-4102-9634-058b7c590848_owjihsdvncdv-master-1@ceph" returned: 0 in 2.190s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:11:43.202671 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] creating volume 'volume-548a92a5-efad-482f-97c9-7684e6c4b453' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:11:43.204443 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:11:43.823595 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:11:43.823877 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:11:43.980865 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Attempting download of 88bbe9a7-19d2-4102-9634-058b7c590848 ((None, None)) to volume 548a92a5-efad-482f-97c9-7684e6c4b453. {{(pid=130674) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1178}}
Apr 16 21:11:44.056848 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_88bbe9a7-19d2-4102-9634-058b7c590848_5p5q8u0_ {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:11:44.180183 ncdv-master-1 sudo[141497]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_88bbe9a7-19d2-4102-9634-058b7c590848_5p5q8u0_
Apr 16 21:11:44.182539 ncdv-master-1 sudo[141497]: pam_unix(sudo:session): session opened for user root by (uid=0)
Apr 16 21:11:45.895227 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_88bbe9a7-19d2-4102-9634-058b7c590848_5p5q8u0_" returned: 0 in 1.824s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:11:45.895227 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_88bbe9a7-19d2-4102-9634-058b7c590848_owjihsdvncdv-master-1@ceph {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:11:45.878768 ncdv-master-1 sudo[141497]: pam_unix(sudo:session): session closed for user root
Apr 16 21:11:46.003231 ncdv-master-1 sudo[141516]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_88bbe9a7-19d2-4102-9634-058b7c590848_owjihsdvncdv-master-1@ceph
Apr 16 21:11:46.004213 ncdv-master-1 sudo[141516]: pam_unix(sudo:session): session opened for user root by (uid=0)
Apr 16 21:11:47.331288 ncdv-master-1 sudo[141516]: pam_unix(sudo:session): session closed for user root
Apr 16 21:11:47.336489 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_88bbe9a7-19d2-4102-9634-058b7c590848_owjihsdvncdv-master-1@ceph" returned: 0 in 1.451s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:11:47.336489 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.image_utils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] 88bbe9a7-19d2-4102-9634-058b7c590848 was vhdx, converting to raw {{(pid=130674) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}}
Apr 16 21:11:47.336489 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_88bbe9a7-19d2-4102-9634-058b7c590848_owjihsdvncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpz5qz66lt {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:11:47.358609 ncdv-master-1 sudo[141523]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_88bbe9a7-19d2-4102-9634-058b7c590848_owjihsdvncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpz5qz66lt
Apr 16 21:11:47.359561 ncdv-master-1 sudo[141523]: pam_unix(sudo:session): session opened for user root by (uid=0)
Apr 16 21:11:47.988284 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-fda3f376-92f6-4894-924d-3dbbb866f637 req-c6a03baf-31eb-4e4c-8ae5-0e47f8fe1d77 tempest-LiveMigrationTest-386991981 None] Terminate volume connection completed successfully.
Apr 16 21:11:47.988866 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-fda3f376-92f6-4894-924d-3dbbb866f637 req-c6a03baf-31eb-4e4c-8ae5-0e47f8fe1d77 tempest-LiveMigrationTest-386991981 None] Deleting attachment 5ccc9fd2-2929-4ded-b172-e2631bfae78b. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:11:49.763807 ncdv-master-1 sudo[141523]: pam_unix(sudo:session): session closed for user root
Apr 16 21:11:49.967420 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_88bbe9a7-19d2-4102-9634-058b7c590848_owjihsdvncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpz5qz66lt" returned: 0 in 2.429s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:11:49.967420 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_88bbe9a7-19d2-4102-9634-058b7c590848_owjihsdvncdv-master-1@ceph {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:11:49.863052 ncdv-master-1 sudo[141546]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_88bbe9a7-19d2-4102-9634-058b7c590848_owjihsdvncdv-master-1@ceph
Apr 16 21:11:49.863867 ncdv-master-1 sudo[141546]: pam_unix(sudo:session): session opened for user root by (uid=0)
Apr 16 21:11:50.935735 ncdv-master-1 sudo[141546]: pam_unix(sudo:session): session closed for user root
Apr 16 21:11:50.937974 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_88bbe9a7-19d2-4102-9634-058b7c590848_owjihsdvncdv-master-1@ceph" returned: 0 in 1.171s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:11:50.938687 ncdv-master-1 cinder-volume[130674]: WARNING py.warnings [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena'
Apr 16 21:11:50.938687 ncdv-master-1 cinder-volume[130674]:   debtcollector.deprecate(
Apr 16 21:11:50.938687 ncdv-master-1 cinder-volume[130674]: 
Apr 16 21:11:50.939311 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.image_utils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_88bbe9a7-19d2-4102-9634-058b7c590848_owjihsdvncdv-master-1@ceph, size 700.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/conversion/tmpz5qz66lt {{(pid=130674) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}}
Apr 16 21:11:50.939683 ncdv-master-1 cinder-volume[130674]: INFO cinder.image.image_utils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Converted 700.00 MB image at 288.03 MB/s
Apr 16 21:11:50.941209 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:11:52.397352 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:11:52.411028 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:11:52.688706 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] deleting rbd volume volume-548a92a5-efad-482f-97c9-7684e6c4b453 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:11:53.059625 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:11:53.080933 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Flow 'volume_create_manager' (546b9408-2cd7-4d15-8db6-d32725640a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:11:53.087763 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3889f72f-957b-4a96-bc0e-d11f90ab3305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:11:53.106329 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3889f72f-957b-4a96-bc0e-d11f90ab3305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-323144117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e18c96ab-5353-4ef3-b372-c892883f3711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b18530cc69c44e6f8a46ca966b3e3a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:11:53Z,use_quota=True,user_id='547d9f3aa3a54867971074b795d83b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:11:53.112381 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668a6fa9-7ae4-4bb9-82d5-65e39cbef213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:11:53.116623 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668a6fa9-7ae4-4bb9-82d5-65e39cbef213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:11:53.121801 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7df629-5202-40ed-908d-5b9ab5417eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:11:53.205795 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7df629-5202-40ed-908d-5b9ab5417eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e18c96ab-5353-4ef3-b372-c892883f3711', 'volume_name': 'volume-e18c96ab-5353-4ef3-b372-c892883f3711', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710c4c340>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:11:53.210929 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f03b5df0-06b5-43b4-a4d9-7fafd182cebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:11:53.215199 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f03b5df0-06b5-43b4-a4d9-7fafd182cebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:11:53.220038 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b54dde7-d236-437c-89ae-15b177963044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:11:53.224714 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Volume e18c96ab-5353-4ef3-b372-c892883f3711: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e18c96ab-5353-4ef3-b372-c892883f3711', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710c4c340>}
Apr 16 21:11:53.224714 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Cloning e18c96ab-5353-4ef3-b372-c892883f3711 from image 88bbe9a7-19d2-4102-9634-058b7c590848  at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 16 21:11:56.604747 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpz5qz66lt volume-548a92a5-efad-482f-97c9-7684e6c4b453 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:12:22.603868 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:12:22.606008 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:12:22.682317 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:12:22.812554 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:12:29.347548 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:12:29.387099 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Flow 'volume_create_manager' (cb6449ff-e5de-4c88-b058-a4f789fbcf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:12:29.395820 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3b9be3-e72d-4aaa-a327-4d6ac025201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:12:29.466626 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3b9be3-e72d-4aaa-a327-4d6ac025201b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-954924206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=00e6b7b1-560b-4bbb-b8e6-499709f33b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce47d3657e50419183b9ee9cee309667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:12:29Z,use_quota=True,user_id='2420585eb37e469da0dab780bf553c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:12:29.486605 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425465c3-ce98-44ea-88bb-dc5e612f3d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:12:29.498611 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425465c3-ce98-44ea-88bb-dc5e612f3d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:12:29.515113 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9b0514-5a36-4035-b739-9d7346a07326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:12:29.667311 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9b0514-5a36-4035-b739-9d7346a07326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '00e6b7b1-560b-4bbb-b8e6-499709f33b8f', 'volume_name': 'volume-00e6b7b1-560b-4bbb-b8e6-499709f33b8f', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7126c06d0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:12:29.688259 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163fb3ed-c73d-4ec0-b6c4-86ebeafe5c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:12:29.698507 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163fb3ed-c73d-4ec0-b6c4-86ebeafe5c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:12:29.703672 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539f5291-0787-4c9b-816d-72e309f6bd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:12:29.714475 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Volume 00e6b7b1-560b-4bbb-b8e6-499709f33b8f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-00e6b7b1-560b-4bbb-b8e6-499709f33b8f', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7126c06d0>}
Apr 16 21:12:29.716681 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Cloning 00e6b7b1-560b-4bbb-b8e6-499709f33b8f from image 88bbe9a7-19d2-4102-9634-058b7c590848  at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 16 21:12:49.140067 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpz5qz66lt volume-548a92a5-efad-482f-97c9-7684e6c4b453 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 52.535s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:12:49.298855 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:12:50.410614 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:12:50.411205 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:12:50.411592 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Downloaded image 88bbe9a7-19d2-4102-9634-058b7c590848 ((None, None)) to volume 548a92a5-efad-482f-97c9-7684e6c4b453 successfully. {{(pid=130674) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1218}}
Apr 16 21:12:50.494477 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.image_utils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Temporary image 88bbe9a7-19d2-4102-9634-058b7c590848 for user 53d5464685cc40d9a1d891c6ae39a80f is deleted. {{(pid=130674) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}}
Apr 16 21:12:50.662232 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:12:50.663993 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:12:50.991355 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Created reservations ['26dd2ab3-15df-428f-a893-fc21425da0c8', '19b890ec-a409-48b7-8bd6-82162deeb693', '69ec9219-6114-40e1-9715-7594fad0e885', '94854c6f-979a-4f49-86d1-2f28e51ce8b0'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:12:51.002676 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Creating image volume entry: {'deleted_at': None, 'terminated_at': None, 'group_id': None, 'bootable': False, 'replication_extended_status': None, 'encryption_key_id': None, 'shared_targets': True, 'display_name': 'image-88bbe9a7-19d2-4102-9634-058b7c590848', 'provider_location': None, 'multiattach': False, 'replication_status': None, 'volume_type_id': 'cb02772d-e253-417b-8d1b-b3b9378a0c4c', 'cluster_name': None, 'consistencygroup_id': None, 'launched_at': None, 'created_at': datetime.datetime(2022, 4, 16, 21, 11, 16, tzinfo=datetime.timezone.utc), 'size': 1, 'project_id': '4cb034afa3444ac9bfb020f072f6e801', 'replication_driver_data': None, 'provider_id': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'provider_geometry': None, 'updated_at': datetime.datetime(2022, 4, 16, 21, 11, 17, tzinfo=datetime.timezone.utc), 'provider_auth': None, 'availability_zone': 'nova', 'deleted': False, 'metadata': {}, 'host': 'ncdv-master-1@ceph#ceph', 'scheduled_at': datetime.datetime(2022, 4, 16, 21, 11, 17, tzinfo=datetime.timezone.utc), 'service_uuid': None, 'volume_metadata': [], 'volume_admin_metadata': [], 'ec2_id': None, 'display_description': None, 'previous_status': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '548a92a5-efad-482f-97c9-7684e6c4b453'}. {{(pid=130674) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1614}}
Apr 16 21:12:51.267135 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Volume reschedule parameters: False retry: None {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:12:51.292012 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Flow 'volume_create_manager' (a765221d-4577-471c-8212-30ffd2119222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:12:51.302069 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c47be5-1b6c-4bfc-8560-319b32b088ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:12:51.319136 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c47be5-1b6c-4bfc-8560-319b32b088ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='image-88bbe9a7-19d2-4102-9634-058b7c590848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e0e222dd-75a5-4728-81e0-d352ad2a6247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb034afa3444ac9bfb020f072f6e801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=548a92a5-efad-482f-97c9-7684e6c4b453,status='creating',terminated_at=None,updated_at=2022-04-16T21:11:17Z,use_quota=True,user_id='53d5464685cc40d9a1d891c6ae39a80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:12:51.327742 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f056ca3d-45c0-42fb-b223-18819758a166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:12:51.332460 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f056ca3d-45c0-42fb-b223-18819758a166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:12:51.357086 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb38d112-2ea6-4588-bdbc-ae6dca9f0e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:12:51.394283 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb38d112-2ea6-4588-bdbc-ae6dca9f0e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'volume_name': 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247', 'volume_size': 1, 'source_volid': '548a92a5-efad-482f-97c9-7684e6c4b453', 'source_volstatus': 'downloading'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:12:51.406743 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334a50e9-eec2-4a9a-b5a1-5c8afb3ef93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:12:51.425004 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334a50e9-eec2-4a9a-b5a1-5c8afb3ef93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:12:51.449872 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbefddcd-74c2-4b1d-8fdd-a879903fb736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:12:51.452038 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Volume e0e222dd-75a5-4728-81e0-d352ad2a6247: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247', 'volume_size': 1, 'source_volid': '548a92a5-efad-482f-97c9-7684e6c4b453', 'source_volstatus': 'downloading'}
Apr 16 21:12:51.483823 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:12:51.711111 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] creating snapshot='volume-e0e222dd-75a5-4728-81e0-d352ad2a6247.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:12:53.295557 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] cloning 'volume-548a92a5-efad-482f-97c9-7684e6c4b453@volume-e0e222dd-75a5-4728-81e0-d352ad2a6247.clone_snap' to 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:12:54.707294 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:12:54.710539 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:12:54.712865 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:12:55.202708 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:12:55.208370 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbefddcd-74c2-4b1d-8fdd-a879903fb736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247', 'volume_size': 1, 'source_volid': '548a92a5-efad-482f-97c9-7684e6c4b453', 'source_volstatus': 'downloading'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:12:55.215750 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b683e85-03db-47eb-8f91-0d541f200ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:12:55.291215 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Volume volume-e0e222dd-75a5-4728-81e0-d352ad2a6247 (e0e222dd-75a5-4728-81e0-d352ad2a6247): created successfully
Apr 16 21:12:55.296151 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b683e85-03db-47eb-8f91-0d541f200ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:12:55.303482 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Flow 'volume_create_manager' (a765221d-4577-471c-8212-30ffd2119222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:12:55.369813 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Created volume successfully.
Apr 16 21:12:55.596993 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Creating new image-volume cache entry for image 88bbe9a7-19d2-4102-9634-058b7c590848 on ncdv-master-1@ceph#ceph {{(pid=130674) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}}
Apr 16 21:12:55.699728 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] New image-volume cache entry created: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 12, 55, 600030)}. {{(pid=130674) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}}
Apr 16 21:12:55.712847 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" released by "_prepare_image_cache_entry" :: held 97.736s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:12:55.713640 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Marking volume 548a92a5-efad-482f-97c9-7684e6c4b453 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:12:55.785333 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Copying metadata from image 88bbe9a7-19d2-4102-9634-058b7c590848 to 548a92a5-efad-482f-97c9-7684e6c4b453. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 16 21:12:55.786100 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Creating volume glance metadata for volume 548a92a5-efad-482f-97c9-7684e6c4b453 backed by image 88bbe9a7-19d2-4102-9634-058b7c590848 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 16 21:12:56.050669 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bccdca3-aef5-4627-9d49-f493d7d512dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-548a92a5-efad-482f-97c9-7684e6c4b453', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7126e7460>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:12:56.055697 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa10112-54a8-4579-9729-73fe688631ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:12:56.132551 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453 (548a92a5-efad-482f-97c9-7684e6c4b453): created successfully
Apr 16 21:12:56.136275 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa10112-54a8-4579-9729-73fe688631ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:12:56.144037 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Flow 'volume_create_manager' (62dbd741-5bd2-4b39-ab04-f6ec75d66651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:12:56.214152 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-66043e2a-251d-4e71-8e73-999752daaadd tempest-LiveAutoBlockMigrationV225Test-566463733 None] Created volume successfully.
Apr 16 21:12:56.364827 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" acquired by "_prepare_image_cache_entry" :: waited 26.639s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:12:56.372112 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 12, 56, 366493)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:12:56.372841 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:12:56.373348 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Found cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 16 21:12:56.378575 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:12:56.379413 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Attempting to retrieve cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 16 21:12:56.386085 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 12, 56, 383542)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:12:56.386665 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:12:56.387162 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Creating from source image-volume e0e222dd-75a5-4728-81e0-d352ad2a6247 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 16 21:12:56.401858 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:12:56.559266 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] creating snapshot='volume-00e6b7b1-560b-4bbb-b8e6-499709f33b8f.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:12:58.141616 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] cloning 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247@volume-00e6b7b1-560b-4bbb-b8e6-499709f33b8f.clone_snap' to 'volume-00e6b7b1-560b-4bbb-b8e6-499709f33b8f' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:12:58.175757 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" acquired by "_prepare_image_cache_entry" :: waited 64.953s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:12:58.273958 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 12, 58, 182375)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:12:58.278052 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:12:58.279379 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Found cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 16 21:12:58.287551 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" released by "_prepare_image_cache_entry" :: held 0.112s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:12:58.290082 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Attempting to retrieve cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 16 21:12:58.304392 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 12, 58, 298967)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:12:58.305320 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:12:58.306850 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Creating from source image-volume e0e222dd-75a5-4728-81e0-d352ad2a6247 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 16 21:12:58.342579 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:12:58.737511 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] creating snapshot='volume-e18c96ab-5353-4ef3-b372-c892883f3711.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:13:00.727124 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] cloning 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247@volume-e18c96ab-5353-4ef3-b372-c892883f3711.clone_snap' to 'volume-e18c96ab-5353-4ef3-b372-c892883f3711' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:13:00.782982 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:13:00.784800 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:13:00.785447 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:13:01.466531 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:13:01.467948 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Marking volume 00e6b7b1-560b-4bbb-b8e6-499709f33b8f as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:13:01.565643 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Copying metadata from image 88bbe9a7-19d2-4102-9634-058b7c590848 to 00e6b7b1-560b-4bbb-b8e6-499709f33b8f. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 16 21:13:01.566371 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Creating volume glance metadata for volume 00e6b7b1-560b-4bbb-b8e6-499709f33b8f backed by image 88bbe9a7-19d2-4102-9634-058b7c590848 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 16 21:13:01.624311 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:13:01.648853 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Flow 'volume_create_manager' (f17112d7-9320-47c8-8b20-8534f593e8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:13:01.657124 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9adab9-8052-40fc-b73e-8a59c617717e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:01.674981 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9adab9-8052-40fc-b73e-8a59c617717e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1164783649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=002930a9-0d49-4ea7-9335-6d515d356336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dc15580ef8a449ca359a9d5b799e24d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:13:00Z,use_quota=True,user_id='453306648f4e4da58ee344c3a51f8110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:01.681638 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7680ae3-c2e3-4322-b074-8b76e0afb149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:01.686831 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7680ae3-c2e3-4322-b074-8b76e0afb149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:01.692733 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce51a2e-8725-4109-9c2d-5843adb22686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:01.697002 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce51a2e-8725-4109-9c2d-5843adb22686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '002930a9-0d49-4ea7-9335-6d515d356336', 'volume_name': 'volume-002930a9-0d49-4ea7-9335-6d515d356336', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:01.703151 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc226b6-503a-41c9-8f72-ec2e3ea5b9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:01.707099 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc226b6-503a-41c9-8f72-ec2e3ea5b9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:01.712021 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31908071-ea8c-4b10-a359-50d489d7bfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:01.713235 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Volume 002930a9-0d49-4ea7-9335-6d515d356336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-002930a9-0d49-4ea7-9335-6d515d356336', 'volume_size': 1}
Apr 16 21:13:01.713542 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] creating volume 'volume-002930a9-0d49-4ea7-9335-6d515d356336' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:13:01.714375 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:13:01.789491 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539f5291-0787-4c9b-816d-72e309f6bd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e6b7b1-560b-4bbb-b8e6-499709f33b8f', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7126c06d0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:01.790427 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49616a00-455d-4c2f-a510-b58d9feb778f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:01.909394 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Volume volume-00e6b7b1-560b-4bbb-b8e6-499709f33b8f (00e6b7b1-560b-4bbb-b8e6-499709f33b8f): created successfully
Apr 16 21:13:01.909394 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49616a00-455d-4c2f-a510-b58d9feb778f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:01.910155 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Flow 'volume_create_manager' (cb6449ff-e5de-4c88-b058-a4f789fbcf6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:13:02.033893 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-887c5bd5-cde2-450d-a6ed-122ab9100d21 tempest-TaggedBootDevicesTest-916837742 None] Created volume successfully.
Apr 16 21:13:03.004691 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:13:03.005693 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:13:03.006281 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:13:03.197618 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:13:03.198232 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Marking volume e18c96ab-5353-4ef3-b372-c892883f3711 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:13:03.209430 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:13:03.210109 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:13:03.222695 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31908071-ea8c-4b10-a359-50d489d7bfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-002930a9-0d49-4ea7-9335-6d515d356336', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:03.234155 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c326417c-1d2d-477b-b708-ea789233db4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:03.322926 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Copying metadata from image 88bbe9a7-19d2-4102-9634-058b7c590848 to e18c96ab-5353-4ef3-b372-c892883f3711. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 16 21:13:03.323928 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Creating volume glance metadata for volume e18c96ab-5353-4ef3-b372-c892883f3711 backed by image 88bbe9a7-19d2-4102-9634-058b7c590848 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 16 21:13:03.361253 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Volume volume-002930a9-0d49-4ea7-9335-6d515d356336 (002930a9-0d49-4ea7-9335-6d515d356336): created successfully
Apr 16 21:13:03.369017 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c326417c-1d2d-477b-b708-ea789233db4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:03.396636 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Flow 'volume_create_manager' (f17112d7-9320-47c8-8b20-8534f593e8d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:13:03.541014 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b1edd105-063a-4218-919a-ad27b37d113e tempest-AttachSCSIVolumeTestJSON-1617782912 None] Created volume successfully.
Apr 16 21:13:03.623820 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b54dde7-d236-437c-89ae-15b177963044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e18c96ab-5353-4ef3-b372-c892883f3711', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710c4c340>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:03.641217 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866ffeff-a0d6-4d41-af80-67ccaa0655ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:03.656627 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:13:03.731513 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Flow 'volume_create_manager' (8abc4bf3-2b03-49b7-81b6-73793301637a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:13:03.750647 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa685591-120b-4b64-b257-2e0117fc541b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:03.756218 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Volume volume-e18c96ab-5353-4ef3-b372-c892883f3711 (e18c96ab-5353-4ef3-b372-c892883f3711): created successfully
Apr 16 21:13:03.760654 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866ffeff-a0d6-4d41-af80-67ccaa0655ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:03.769784 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Flow 'volume_create_manager' (546b9408-2cd7-4d15-8db6-d32725640a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:13:03.818901 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa685591-120b-4b64-b257-2e0117fc541b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1660109342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=743c3f5e-43a6-4c29-bbca-fd48d7b20968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce47d3657e50419183b9ee9cee309667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:13:03Z,use_quota=True,user_id='2420585eb37e469da0dab780bf553c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:03.834676 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4965da84-1ba2-4a2b-becc-35a91eded2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:03.845721 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4965da84-1ba2-4a2b-becc-35a91eded2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:03.852202 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530fc4d8-601f-48dd-8041-5354b251b7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:03.856774 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530fc4d8-601f-48dd-8041-5354b251b7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '743c3f5e-43a6-4c29-bbca-fd48d7b20968', 'volume_name': 'volume-743c3f5e-43a6-4c29-bbca-fd48d7b20968', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:03.864320 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea418f1-f2c8-45fe-a610-cb9400d3ea20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:03.868461 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea418f1-f2c8-45fe-a610-cb9400d3ea20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:03.874071 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c2464b-69ec-4d76-9e2e-83bdb0ebdff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:03.875433 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Volume 743c3f5e-43a6-4c29-bbca-fd48d7b20968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-743c3f5e-43a6-4c29-bbca-fd48d7b20968', 'volume_size': 1}
Apr 16 21:13:03.875988 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] creating volume 'volume-743c3f5e-43a6-4c29-bbca-fd48d7b20968' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:13:03.876855 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:13:04.045669 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f747934e-6b5f-4cd7-947c-413605323227 tempest-LiveMigrationTest-386991981 None] Created volume successfully.
Apr 16 21:13:04.439836 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-68929ba6-d6b8-4fa7-b226-756aadfa6402 req-42581952-9f5d-4c06-bd57-58b405619346 tempest-LiveAutoBlockMigrationV225Test-566463733 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:13:04.690821 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:13:04.690821 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:13:04.712070 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c2464b-69ec-4d76-9e2e-83bdb0ebdff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-743c3f5e-43a6-4c29-bbca-fd48d7b20968', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:04.728549 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732b8ec9-3f53-4490-87d5-f2dbc2bacb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:04.837978 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Volume volume-743c3f5e-43a6-4c29-bbca-fd48d7b20968 (743c3f5e-43a6-4c29-bbca-fd48d7b20968): created successfully
Apr 16 21:13:04.845831 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732b8ec9-3f53-4490-87d5-f2dbc2bacb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:04.865369 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Flow 'volume_create_manager' (8abc4bf3-2b03-49b7-81b6-73793301637a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:13:04.959913 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7d783c6e-7a57-486b-8799-9764e33d439f tempest-TaggedBootDevicesTest-916837742 None] Created volume successfully.
Apr 16 21:13:05.916091 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-68929ba6-d6b8-4fa7-b226-756aadfa6402 req-42581952-9f5d-4c06-bd57-58b405619346 tempest-LiveAutoBlockMigrationV225Test-566463733 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.476s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:13:05.920473 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-68929ba6-d6b8-4fa7-b226-756aadfa6402 req-42581952-9f5d-4c06-bd57-58b405619346 tempest-LiveAutoBlockMigrationV225Test-566463733 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-548a92a5-efad-482f-97c9-7684e6c4b453', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '548a92a5-efad-482f-97c9-7684e6c4b453', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:13:06.014450 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-68929ba6-d6b8-4fa7-b226-756aadfa6402 req-42581952-9f5d-4c06-bd57-58b405619346 tempest-LiveAutoBlockMigrationV225Test-566463733 None] Connection info returned from driver {'name': 'volumes/volume-548a92a5-efad-482f-97c9-7684e6c4b453', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '548a92a5-efad-482f-97c9-7684e6c4b453', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3d9f0f23-06dc-4657-89d5-91784ea70a72'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:13:06.243117 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-68929ba6-d6b8-4fa7-b226-756aadfa6402 req-42581952-9f5d-4c06-bd57-58b405619346 tempest-LiveAutoBlockMigrationV225Test-566463733 None] attachment_update completed successfully.
Apr 16 21:13:06.943812 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:13:06.985068 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Flow 'volume_create_manager' (10eddd95-5189-4609-bc0d-283f5092b355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:13:06.993456 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4d4c4b-f59e-4bae-9ef7-1724fcd23ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:07.020935 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4d4c4b-f59e-4bae-9ef7-1724fcd23ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1246103356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7aad57cb-6f75-4d84-a883-22ddddb6aad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce47d3657e50419183b9ee9cee309667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:13:07Z,use_quota=True,user_id='2420585eb37e469da0dab780bf553c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:07.026902 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af71b59a-cf74-4c13-972a-47a3cb2e1c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:07.032078 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af71b59a-cf74-4c13-972a-47a3cb2e1c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:07.038190 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d4698e-877c-4a57-b1c6-87dbd59db3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:07.043359 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d4698e-877c-4a57-b1c6-87dbd59db3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aad57cb-6f75-4d84-a883-22ddddb6aad5', 'volume_name': 'volume-7aad57cb-6f75-4d84-a883-22ddddb6aad5', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:07.052049 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069f7247-e522-4fbb-9cc2-6578f98eb46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:07.058276 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069f7247-e522-4fbb-9cc2-6578f98eb46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:07.076701 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a812a58e-1286-4bbe-aee1-1c35f26fc445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:07.078772 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Volume 7aad57cb-6f75-4d84-a883-22ddddb6aad5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aad57cb-6f75-4d84-a883-22ddddb6aad5', 'volume_size': 1}
Apr 16 21:13:07.079356 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] creating volume 'volume-7aad57cb-6f75-4d84-a883-22ddddb6aad5' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:13:07.080643 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:13:07.159038 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-a5ef21c8-6598-439d-a506-a4d660f06298 req-0d784f80-6525-4948-90b5-e63e350e06de tempest-AttachSCSIVolumeTestJSON-1617782912 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:13:07.822092 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:13:07.822590 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:13:07.827560 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a812a58e-1286-4bbe-aee1-1c35f26fc445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aad57cb-6f75-4d84-a883-22ddddb6aad5', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:07.858361 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34305d8-4574-42f1-a0b5-59f53a1e1f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:07.994220 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Volume volume-7aad57cb-6f75-4d84-a883-22ddddb6aad5 (7aad57cb-6f75-4d84-a883-22ddddb6aad5): created successfully
Apr 16 21:13:07.998270 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34305d8-4574-42f1-a0b5-59f53a1e1f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:08.004371 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Flow 'volume_create_manager' (10eddd95-5189-4609-bc0d-283f5092b355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:13:08.117081 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c42b50e6-f4f8-4ff6-992e-2f8e5961ba67 tempest-TaggedBootDevicesTest-916837742 None] Created volume successfully.
Apr 16 21:13:08.993964 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-a5ef21c8-6598-439d-a506-a4d660f06298 req-0d784f80-6525-4948-90b5-e63e350e06de tempest-AttachSCSIVolumeTestJSON-1617782912 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.835s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:13:08.995486 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-a5ef21c8-6598-439d-a506-a4d660f06298 req-0d784f80-6525-4948-90b5-e63e350e06de tempest-AttachSCSIVolumeTestJSON-1617782912 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-002930a9-0d49-4ea7-9335-6d515d356336', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '002930a9-0d49-4ea7-9335-6d515d356336', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:13:09.171718 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-a5ef21c8-6598-439d-a506-a4d660f06298 req-0d784f80-6525-4948-90b5-e63e350e06de tempest-AttachSCSIVolumeTestJSON-1617782912 None] Connection info returned from driver {'name': 'volumes/volume-002930a9-0d49-4ea7-9335-6d515d356336', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '002930a9-0d49-4ea7-9335-6d515d356336', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'aee2ecef-1d63-41eb-8b9f-3f791f39388c'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:13:09.383984 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-a5ef21c8-6598-439d-a506-a4d660f06298 req-0d784f80-6525-4948-90b5-e63e350e06de tempest-AttachSCSIVolumeTestJSON-1617782912 None] attachment_update completed successfully.
Apr 16 21:13:11.313701 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-03631e84-276b-43f5-b658-357c8103f91d req-7ba8c1cc-9801-4fc4-af96-fa5cdea80f28 tempest-LiveMigrationTest-386991981 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:13:12.528528 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-03631e84-276b-43f5-b658-357c8103f91d req-7ba8c1cc-9801-4fc4-af96-fa5cdea80f28 tempest-LiveMigrationTest-386991981 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.215s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:13:12.543098 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-03631e84-276b-43f5-b658-357c8103f91d req-7ba8c1cc-9801-4fc4-af96-fa5cdea80f28 tempest-LiveMigrationTest-386991981 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e18c96ab-5353-4ef3-b372-c892883f3711', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'e18c96ab-5353-4ef3-b372-c892883f3711', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:13:12.690877 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-03631e84-276b-43f5-b658-357c8103f91d req-7ba8c1cc-9801-4fc4-af96-fa5cdea80f28 tempest-LiveMigrationTest-386991981 None] Connection info returned from driver {'name': 'volumes/volume-e18c96ab-5353-4ef3-b372-c892883f3711', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e18c96ab-5353-4ef3-b372-c892883f3711', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3d7f5078-64d1-4cce-a7ab-3a039dd4ba0a'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:13:12.967024 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-03631e84-276b-43f5-b658-357c8103f91d req-7ba8c1cc-9801-4fc4-af96-fa5cdea80f28 tempest-LiveMigrationTest-386991981 None] attachment_update completed successfully.
Apr 16 21:13:16.131934 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-753e843c-bb55-40bc-8564-8b99840b692e req-a811e062-1003-4b8f-8001-0f70a043c967 tempest-AttachSCSIVolumeTestJSON-1617782912 None] Terminate volume connection completed successfully.
Apr 16 21:13:16.133525 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-753e843c-bb55-40bc-8564-8b99840b692e req-a811e062-1003-4b8f-8001-0f70a043c967 tempest-AttachSCSIVolumeTestJSON-1617782912 None] Deleting attachment aee2ecef-1d63-41eb-8b9f-3f791f39388c. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:13:22.609052 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:13:22.610326 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:13:22.727757 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:13:22.806605 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:13:24.802202 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:13:24.875210 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Flow 'volume_create_manager' (be6d7d12-5050-4d42-acd9-9d009fd66146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:13:24.892494 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a234964-24f8-4adb-8800-5461d3f9b7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:24.913875 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a234964-24f8-4adb-8800-5461d3f9b7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1613244614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1706c0a9-c59e-4441-98fb-6e924e9769cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='840fd4cbe2fd414bb97f14898bf9647d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:13:25Z,use_quota=True,user_id='1a6ff623974d4156a05a7bd3e3b3ed5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:24.924591 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17c4777-bf21-45e9-83b4-3d221e9e6a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:24.926585 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17c4777-bf21-45e9-83b4-3d221e9e6a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:24.932713 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00187460-c048-4b11-bcbe-b0c1d00942f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:25.098614 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00187460-c048-4b11-bcbe-b0c1d00942f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1706c0a9-c59e-4441-98fb-6e924e9769cf', 'volume_name': 'volume-1706c0a9-c59e-4441-98fb-6e924e9769cf', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710c0bca0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:25.105503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f38dd274-254f-45e4-a151-3077ccb1f3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:25.122987 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f38dd274-254f-45e4-a151-3077ccb1f3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:25.129324 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c829a644-eead-4de7-8943-efd5262ece5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:25.130861 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Volume 1706c0a9-c59e-4441-98fb-6e924e9769cf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1706c0a9-c59e-4441-98fb-6e924e9769cf', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710c0bca0>}
Apr 16 21:13:25.132843 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Cloning 1706c0a9-c59e-4441-98fb-6e924e9769cf from image 88bbe9a7-19d2-4102-9634-058b7c590848  at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 16 21:13:25.144356 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:13:25.299676 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 13, 25, 149271)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:13:25.300545 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:13:25.303770 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Found cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 16 21:13:25.308274 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" released by "_prepare_image_cache_entry" :: held 0.164s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:13:25.309308 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Attempting to retrieve cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 16 21:13:25.326201 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 13, 25, 315356)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:13:25.335822 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:13:25.336670 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Creating from source image-volume e0e222dd-75a5-4728-81e0-d352ad2a6247 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 16 21:13:25.382579 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:13:25.650267 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] creating snapshot='volume-1706c0a9-c59e-4441-98fb-6e924e9769cf.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:13:27.822685 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] cloning 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247@volume-1706c0a9-c59e-4441-98fb-6e924e9769cf.clone_snap' to 'volume-1706c0a9-c59e-4441-98fb-6e924e9769cf' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:13:29.403633 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:13:29.403633 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:13:29.403633 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:13:30.083059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:13:30.083852 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Marking volume 1706c0a9-c59e-4441-98fb-6e924e9769cf as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:13:30.210492 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Copying metadata from image 88bbe9a7-19d2-4102-9634-058b7c590848 to 1706c0a9-c59e-4441-98fb-6e924e9769cf. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 16 21:13:30.210986 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Creating volume glance metadata for volume 1706c0a9-c59e-4441-98fb-6e924e9769cf backed by image 88bbe9a7-19d2-4102-9634-058b7c590848 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 16 21:13:30.332508 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c829a644-eead-4de7-8943-efd5262ece5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1706c0a9-c59e-4441-98fb-6e924e9769cf', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710c0bca0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:30.338167 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8175b3a0-61a3-4a47-9579-d188ace42e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:13:30.471180 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Volume volume-1706c0a9-c59e-4441-98fb-6e924e9769cf (1706c0a9-c59e-4441-98fb-6e924e9769cf): created successfully
Apr 16 21:13:30.475409 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8175b3a0-61a3-4a47-9579-d188ace42e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:13:30.481495 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Flow 'volume_create_manager' (be6d7d12-5050-4d42-acd9-9d009fd66146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:13:30.570537 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-24f9a275-b477-472a-b3ab-5344b69b8415 tempest-ServersTestBootFromVolume-1004751907 None] Created volume successfully.
Apr 16 21:13:31.626995 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-4da39854-bb87-4977-abe1-f5c5c6540aeb tempest-AttachSCSIVolumeTestJSON-1617782912 None] Lock "b'cinder-002930a9-0d49-4ea7-9335-6d515d356336-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:13:31.730309 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4da39854-bb87-4977-abe1-f5c5c6540aeb tempest-AttachSCSIVolumeTestJSON-1617782912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:13:31.878701 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4da39854-bb87-4977-abe1-f5c5c6540aeb tempest-AttachSCSIVolumeTestJSON-1617782912 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:13:31.879057 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4da39854-bb87-4977-abe1-f5c5c6540aeb tempest-AttachSCSIVolumeTestJSON-1617782912 None] Volume volume-002930a9-0d49-4ea7-9335-6d515d356336 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:13:31.971649 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4da39854-bb87-4977-abe1-f5c5c6540aeb tempest-AttachSCSIVolumeTestJSON-1617782912 None] deleting rbd volume volume-002930a9-0d49-4ea7-9335-6d515d356336 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:13:33.958063 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-85ec2f90-2c14-49d1-b3ca-85327593a286 req-bda07ab3-dc35-4cf2-af8a-875985ea5409 tempest-LiveAutoBlockMigrationV225Test-809890570 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:13:34.634138 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-85ec2f90-2c14-49d1-b3ca-85327593a286 req-bda07ab3-dc35-4cf2-af8a-875985ea5409 tempest-LiveAutoBlockMigrationV225Test-809890570 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.675s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:13:34.635261 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-85ec2f90-2c14-49d1-b3ca-85327593a286 req-bda07ab3-dc35-4cf2-af8a-875985ea5409 tempest-LiveAutoBlockMigrationV225Test-809890570 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-548a92a5-efad-482f-97c9-7684e6c4b453', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '548a92a5-efad-482f-97c9-7684e6c4b453', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:13:34.736232 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-85ec2f90-2c14-49d1-b3ca-85327593a286 req-bda07ab3-dc35-4cf2-af8a-875985ea5409 tempest-LiveAutoBlockMigrationV225Test-809890570 None] Connection info returned from driver {'name': 'volumes/volume-548a92a5-efad-482f-97c9-7684e6c4b453', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '548a92a5-efad-482f-97c9-7684e6c4b453', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '62211391-a083-4946-8f9b-2a7a65f949c5'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:13:34.925015 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-85ec2f90-2c14-49d1-b3ca-85327593a286 req-bda07ab3-dc35-4cf2-af8a-875985ea5409 tempest-LiveAutoBlockMigrationV225Test-809890570 None] attachment_update completed successfully.
Apr 16 21:13:36.062469 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-4da39854-bb87-4977-abe1-f5c5c6540aeb tempest-AttachSCSIVolumeTestJSON-1617782912 None] Created reservations ['be8e2a84-2ea8-4298-ac28-d3fe250d2832', '4823de5d-8df1-4739-9b9d-997631a3eea7', '3a8f93ca-7524-464a-b301-4cafb0c0dc66', '275b3dfa-58c5-42d1-96bd-002b886893f9'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:13:36.306549 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4da39854-bb87-4977-abe1-f5c5c6540aeb tempest-AttachSCSIVolumeTestJSON-1617782912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:13:36.356609 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4da39854-bb87-4977-abe1-f5c5c6540aeb tempest-AttachSCSIVolumeTestJSON-1617782912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:13:36.401139 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-4da39854-bb87-4977-abe1-f5c5c6540aeb tempest-AttachSCSIVolumeTestJSON-1617782912 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:13:36.406281 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4da39854-bb87-4977-abe1-f5c5c6540aeb tempest-AttachSCSIVolumeTestJSON-1617782912 None] Deleted volume successfully.
Apr 16 21:13:36.514916 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-4da39854-bb87-4977-abe1-f5c5c6540aeb tempest-AttachSCSIVolumeTestJSON-1617782912 None] Lock "b'cinder-002930a9-0d49-4ea7-9335-6d515d356336-delete_volume'" released by "delete_volume" :: held 4.888s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:13:38.772689 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 req-97df6e2d-f9e6-4d68-84eb-90c23231bcd5 tempest-ServersTestBootFromVolume-1004751907 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:13:39.734344 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 req-97df6e2d-f9e6-4d68-84eb-90c23231bcd5 tempest-ServersTestBootFromVolume-1004751907 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.961s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:13:39.735511 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 req-97df6e2d-f9e6-4d68-84eb-90c23231bcd5 tempest-ServersTestBootFromVolume-1004751907 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1706c0a9-c59e-4441-98fb-6e924e9769cf', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '1706c0a9-c59e-4441-98fb-6e924e9769cf', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:13:40.185962 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 req-97df6e2d-f9e6-4d68-84eb-90c23231bcd5 tempest-ServersTestBootFromVolume-1004751907 None] Connection info returned from driver {'name': 'volumes/volume-1706c0a9-c59e-4441-98fb-6e924e9769cf', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1706c0a9-c59e-4441-98fb-6e924e9769cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd104ab34-695d-493d-84f7-7428eed2c0b7'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:13:40.397263 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 req-97df6e2d-f9e6-4d68-84eb-90c23231bcd5 tempest-ServersTestBootFromVolume-1004751907 None] attachment_update completed successfully.
Apr 16 21:13:41.653539 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-02183253-9d49-4c46-a1d6-5a08500adde2 req-dc5c133d-4cc6-4514-abaa-3c06c5a203a1 tempest-TaggedBootDevicesTest-916837742 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:13:42.937949 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-02183253-9d49-4c46-a1d6-5a08500adde2 req-dc5c133d-4cc6-4514-abaa-3c06c5a203a1 tempest-TaggedBootDevicesTest-916837742 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.288s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:13:42.939374 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-02183253-9d49-4c46-a1d6-5a08500adde2 req-dc5c133d-4cc6-4514-abaa-3c06c5a203a1 tempest-TaggedBootDevicesTest-916837742 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-00e6b7b1-560b-4bbb-b8e6-499709f33b8f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '00e6b7b1-560b-4bbb-b8e6-499709f33b8f', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:13:43.071181 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-02183253-9d49-4c46-a1d6-5a08500adde2 req-dc5c133d-4cc6-4514-abaa-3c06c5a203a1 tempest-TaggedBootDevicesTest-916837742 None] Connection info returned from driver {'name': 'volumes/volume-00e6b7b1-560b-4bbb-b8e6-499709f33b8f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '00e6b7b1-560b-4bbb-b8e6-499709f33b8f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '679cdcdf-720b-4d09-84ec-b2597ea1047f'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:13:43.349889 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-02183253-9d49-4c46-a1d6-5a08500adde2 req-dc5c133d-4cc6-4514-abaa-3c06c5a203a1 tempest-TaggedBootDevicesTest-916837742 None] attachment_update completed successfully.
Apr 16 21:13:44.450163 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-02183253-9d49-4c46-a1d6-5a08500adde2 req-fd43dd37-d034-4c94-9b23-d18af7ca26e1 tempest-TaggedBootDevicesTest-916837742 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:13:45.063794 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e req-2364d657-468d-4ba1-98db-aa2e4ddd37eb tempest-LiveMigrationTest-2010750960 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:13:46.087614 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-02183253-9d49-4c46-a1d6-5a08500adde2 req-fd43dd37-d034-4c94-9b23-d18af7ca26e1 tempest-TaggedBootDevicesTest-916837742 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.637s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:13:46.088663 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-02183253-9d49-4c46-a1d6-5a08500adde2 req-fd43dd37-d034-4c94-9b23-d18af7ca26e1 tempest-TaggedBootDevicesTest-916837742 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-743c3f5e-43a6-4c29-bbca-fd48d7b20968', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '743c3f5e-43a6-4c29-bbca-fd48d7b20968', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:13:46.236517 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-02183253-9d49-4c46-a1d6-5a08500adde2 req-fd43dd37-d034-4c94-9b23-d18af7ca26e1 tempest-TaggedBootDevicesTest-916837742 None] Connection info returned from driver {'name': 'volumes/volume-743c3f5e-43a6-4c29-bbca-fd48d7b20968', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '743c3f5e-43a6-4c29-bbca-fd48d7b20968', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3cc0f3d8-17d6-4a17-a390-2c4e2e413956'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:13:46.573748 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-02183253-9d49-4c46-a1d6-5a08500adde2 req-fd43dd37-d034-4c94-9b23-d18af7ca26e1 tempest-TaggedBootDevicesTest-916837742 None] attachment_update completed successfully.
Apr 16 21:13:46.989104 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e req-2364d657-468d-4ba1-98db-aa2e4ddd37eb tempest-LiveMigrationTest-2010750960 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.926s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:13:46.989746 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e req-2364d657-468d-4ba1-98db-aa2e4ddd37eb tempest-LiveMigrationTest-2010750960 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e18c96ab-5353-4ef3-b372-c892883f3711', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'e18c96ab-5353-4ef3-b372-c892883f3711', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:13:47.185534 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e req-2364d657-468d-4ba1-98db-aa2e4ddd37eb tempest-LiveMigrationTest-2010750960 None] Connection info returned from driver {'name': 'volumes/volume-e18c96ab-5353-4ef3-b372-c892883f3711', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e18c96ab-5353-4ef3-b372-c892883f3711', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '34184aa9-f1f4-4602-b9c4-7e87f1d824fe'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:13:47.571848 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e req-2364d657-468d-4ba1-98db-aa2e4ddd37eb tempest-LiveMigrationTest-2010750960 None] attachment_update completed successfully.
Apr 16 21:13:47.736864 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-02183253-9d49-4c46-a1d6-5a08500adde2 req-6f8d0346-b250-42d5-bae6-acc7ae7f1dfa tempest-TaggedBootDevicesTest-916837742 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:13:48.121974 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-85ec2f90-2c14-49d1-b3ca-85327593a286 req-e16cd5d7-f22a-49e1-9d49-e802d354b8ab tempest-LiveAutoBlockMigrationV225Test-809890570 None] Terminate volume connection completed successfully.
Apr 16 21:13:48.122593 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-85ec2f90-2c14-49d1-b3ca-85327593a286 req-e16cd5d7-f22a-49e1-9d49-e802d354b8ab tempest-LiveAutoBlockMigrationV225Test-809890570 None] Deleting attachment 3d9f0f23-06dc-4657-89d5-91784ea70a72. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:13:48.529945 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-02183253-9d49-4c46-a1d6-5a08500adde2 req-6f8d0346-b250-42d5-bae6-acc7ae7f1dfa tempest-TaggedBootDevicesTest-916837742 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.796s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:13:48.530670 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-02183253-9d49-4c46-a1d6-5a08500adde2 req-6f8d0346-b250-42d5-bae6-acc7ae7f1dfa tempest-TaggedBootDevicesTest-916837742 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7aad57cb-6f75-4d84-a883-22ddddb6aad5', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '7aad57cb-6f75-4d84-a883-22ddddb6aad5', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:13:48.785556 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-02183253-9d49-4c46-a1d6-5a08500adde2 req-6f8d0346-b250-42d5-bae6-acc7ae7f1dfa tempest-TaggedBootDevicesTest-916837742 None] Connection info returned from driver {'name': 'volumes/volume-7aad57cb-6f75-4d84-a883-22ddddb6aad5', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7aad57cb-6f75-4d84-a883-22ddddb6aad5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '655143f5-7614-4208-9b28-b57596c0ca79'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:13:49.056089 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-02183253-9d49-4c46-a1d6-5a08500adde2 req-6f8d0346-b250-42d5-bae6-acc7ae7f1dfa tempest-TaggedBootDevicesTest-916837742 None] attachment_update completed successfully.
Apr 16 21:14:00.325097 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e req-ba85fe92-f2ba-4d11-908c-a48547a4d84e tempest-LiveMigrationTest-2010750960 None] Terminate volume connection completed successfully.
Apr 16 21:14:00.326332 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e req-ba85fe92-f2ba-4d11-908c-a48547a4d84e tempest-LiveMigrationTest-2010750960 None] Deleting attachment 3d7f5078-64d1-4cce-a7ab-3a039dd4ba0a. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:14:00.800842 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-71bfbadf-33d1-4d85-abe5-04c58af464d8 req-c09e5521-8bdb-4368-97f6-cd39dfa7f3dc tempest-LiveAutoBlockMigrationV225Test-566463733 None] Terminate volume connection completed successfully.
Apr 16 21:14:00.801503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-71bfbadf-33d1-4d85-abe5-04c58af464d8 req-c09e5521-8bdb-4368-97f6-cd39dfa7f3dc tempest-LiveAutoBlockMigrationV225Test-566463733 None] Deleting attachment 62211391-a083-4946-8f9b-2a7a65f949c5. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:14:01.334161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-71bfbadf-33d1-4d85-abe5-04c58af464d8 req-9e48d0d5-2150-432c-bbf4-f6e385887e6c tempest-LiveAutoBlockMigrationV225Test-566463733 None] Lock "b'cinder-548a92a5-efad-482f-97c9-7684e6c4b453-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:14:01.496847 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-71bfbadf-33d1-4d85-abe5-04c58af464d8 req-9e48d0d5-2150-432c-bbf4-f6e385887e6c tempest-LiveAutoBlockMigrationV225Test-566463733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:14:01.857418 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-71bfbadf-33d1-4d85-abe5-04c58af464d8 req-9e48d0d5-2150-432c-bbf4-f6e385887e6c tempest-LiveAutoBlockMigrationV225Test-566463733 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:14:01.865799 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-71bfbadf-33d1-4d85-abe5-04c58af464d8 req-9e48d0d5-2150-432c-bbf4-f6e385887e6c tempest-LiveAutoBlockMigrationV225Test-566463733 None] volume has clone snapshot(s) {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1284}}
Apr 16 21:14:01.865799 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-71bfbadf-33d1-4d85-abe5-04c58af464d8 req-9e48d0d5-2150-432c-bbf4-f6e385887e6c tempest-LiveAutoBlockMigrationV225Test-566463733 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:14:02.438890 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0aa67d16-1272-423e-8057-83e83848a809 tempest-LiveAutoBlockMigrationV225Test-566463733 None] Lock "b'cinder-a0bbd6c4-67eb-4f42-a9e2-e08052fd877f-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:14:02.563776 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0aa67d16-1272-423e-8057-83e83848a809 tempest-LiveAutoBlockMigrationV225Test-566463733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:14:02.980961 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0aa67d16-1272-423e-8057-83e83848a809 tempest-LiveAutoBlockMigrationV225Test-566463733 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:14:02.985452 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0aa67d16-1272-423e-8057-83e83848a809 tempest-LiveAutoBlockMigrationV225Test-566463733 None] Volume volume-a0bbd6c4-67eb-4f42-a9e2-e08052fd877f is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:14:03.245026 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0aa67d16-1272-423e-8057-83e83848a809 tempest-LiveAutoBlockMigrationV225Test-566463733 None] deleting rbd volume volume-a0bbd6c4-67eb-4f42-a9e2-e08052fd877f {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:14:04.905349 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-71bfbadf-33d1-4d85-abe5-04c58af464d8 req-9e48d0d5-2150-432c-bbf4-f6e385887e6c tempest-LiveAutoBlockMigrationV225Test-566463733 None] Created reservations ['9cb7c07e-9f43-4de2-bce2-a65f32049b8c', 'bfe6fe2a-807a-4116-91ff-6801080e40ea', 'b7d0e8e5-06f5-41ae-9d08-28cdf5dd27a4', '8ccbb967-1d7b-45cb-be6a-e51042380b72'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:14:05.125093 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-71bfbadf-33d1-4d85-abe5-04c58af464d8 req-9e48d0d5-2150-432c-bbf4-f6e385887e6c tempest-LiveAutoBlockMigrationV225Test-566463733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:14:05.212748 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-71bfbadf-33d1-4d85-abe5-04c58af464d8 req-9e48d0d5-2150-432c-bbf4-f6e385887e6c tempest-LiveAutoBlockMigrationV225Test-566463733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:14:05.271741 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-71bfbadf-33d1-4d85-abe5-04c58af464d8 req-9e48d0d5-2150-432c-bbf4-f6e385887e6c tempest-LiveAutoBlockMigrationV225Test-566463733 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:14:05.276447 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-71bfbadf-33d1-4d85-abe5-04c58af464d8 req-9e48d0d5-2150-432c-bbf4-f6e385887e6c tempest-LiveAutoBlockMigrationV225Test-566463733 None] Deleted volume successfully.
Apr 16 21:14:05.369710 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-71bfbadf-33d1-4d85-abe5-04c58af464d8 req-9e48d0d5-2150-432c-bbf4-f6e385887e6c tempest-LiveAutoBlockMigrationV225Test-566463733 None] Lock "b'cinder-548a92a5-efad-482f-97c9-7684e6c4b453-delete_volume'" released by "delete_volume" :: held 4.036s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:14:10.609972 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-0aa67d16-1272-423e-8057-83e83848a809 tempest-LiveAutoBlockMigrationV225Test-566463733 None] Created reservations ['f58d4cbf-af5a-4e5b-ba5d-2940915bb315', '17eddf92-8f76-4817-afd2-c9dd05614a36', '68fcb1fd-4af4-43d9-99ee-bb88c4d6f22f', '1390bc61-1a9a-4a6b-b90d-388d8eda8a56'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:14:10.893948 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0aa67d16-1272-423e-8057-83e83848a809 tempest-LiveAutoBlockMigrationV225Test-566463733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:14:11.057397 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0aa67d16-1272-423e-8057-83e83848a809 tempest-LiveAutoBlockMigrationV225Test-566463733 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:14:11.150274 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-0aa67d16-1272-423e-8057-83e83848a809 tempest-LiveAutoBlockMigrationV225Test-566463733 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:14:11.165109 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0aa67d16-1272-423e-8057-83e83848a809 tempest-LiveAutoBlockMigrationV225Test-566463733 None] Deleted volume successfully.
Apr 16 21:14:11.254402 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0aa67d16-1272-423e-8057-83e83848a809 tempest-LiveAutoBlockMigrationV225Test-566463733 None] Lock "b'cinder-a0bbd6c4-67eb-4f42-a9e2-e08052fd877f-delete_volume'" released by "delete_volume" :: held 8.815s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:14:22.606907 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:14:22.608013 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:14:22.637041 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:14:22.692745 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:14:33.201961 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-dbfd5a99-6a60-4f7f-9254-a948c3844757 req-dfc524fd-e9c7-4703-84f3-d15241c385f6 tempest-LiveMigrationTest-386991981 None] Terminate volume connection completed successfully.
Apr 16 21:14:33.205124 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-dbfd5a99-6a60-4f7f-9254-a948c3844757 req-dfc524fd-e9c7-4703-84f3-d15241c385f6 tempest-LiveMigrationTest-386991981 None] Deleting attachment 34184aa9-f1f4-4602-b9c4-7e87f1d824fe. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:14:33.768118 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-dbfd5a99-6a60-4f7f-9254-a948c3844757 req-283c1062-4cd5-40d2-81ca-35494daf73ea tempest-LiveMigrationTest-386991981 None] Lock "b'cinder-e18c96ab-5353-4ef3-b372-c892883f3711-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:14:33.897875 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-dbfd5a99-6a60-4f7f-9254-a948c3844757 req-283c1062-4cd5-40d2-81ca-35494daf73ea tempest-LiveMigrationTest-386991981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:14:34.776866 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-dbfd5a99-6a60-4f7f-9254-a948c3844757 req-283c1062-4cd5-40d2-81ca-35494daf73ea tempest-LiveMigrationTest-386991981 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:14:35.273757 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-dbfd5a99-6a60-4f7f-9254-a948c3844757 req-283c1062-4cd5-40d2-81ca-35494daf73ea tempest-LiveMigrationTest-386991981 None] deleting rbd volume volume-e18c96ab-5353-4ef3-b372-c892883f3711 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:14:36.280891 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-e5d760da-c4ce-4838-be40-4f61d76b9b46 tempest-LiveMigrationTest-386991981 None] Lock "b'cinder-47811ce7-10e6-4421-b54d-89b4bcfc2df7-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:14:36.494485 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e5d760da-c4ce-4838-be40-4f61d76b9b46 tempest-LiveMigrationTest-386991981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:14:36.866331 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e5d760da-c4ce-4838-be40-4f61d76b9b46 tempest-LiveMigrationTest-386991981 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:14:36.867098 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e5d760da-c4ce-4838-be40-4f61d76b9b46 tempest-LiveMigrationTest-386991981 None] Volume volume-47811ce7-10e6-4421-b54d-89b4bcfc2df7 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:14:37.140511 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e5d760da-c4ce-4838-be40-4f61d76b9b46 tempest-LiveMigrationTest-386991981 None] deleting rbd volume volume-47811ce7-10e6-4421-b54d-89b4bcfc2df7 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:14:45.614645 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-dbfd5a99-6a60-4f7f-9254-a948c3844757 req-283c1062-4cd5-40d2-81ca-35494daf73ea tempest-LiveMigrationTest-386991981 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:14:45.906301 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-dbfd5a99-6a60-4f7f-9254-a948c3844757 req-283c1062-4cd5-40d2-81ca-35494daf73ea tempest-LiveMigrationTest-386991981 None] deleting parent snapshot volume-e18c96ab-5353-4ef3-b372-c892883f3711.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:14:49.587257 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-dbfd5a99-6a60-4f7f-9254-a948c3844757 req-283c1062-4cd5-40d2-81ca-35494daf73ea tempest-LiveMigrationTest-386991981 None] Created reservations ['9d1d51ad-456c-416a-bf9a-6badf3ec6e09', '1972672c-63a8-4a3e-8b07-3c899f8d8d7a', '2e2991b1-d65c-462f-941d-053f89694750', 'eb00af39-88dd-45a9-a260-05fdfbd500cf'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:14:49.726307 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-e5d760da-c4ce-4838-be40-4f61d76b9b46 tempest-LiveMigrationTest-386991981 None] Created reservations ['b68dbb5c-b91a-4830-964a-2b1ef6410604', 'fff3faca-b0bf-4626-8fa2-0d987359b819', 'ff02ceae-b807-45e9-978a-d87055a12208', '475da1d7-eb26-431a-97e7-11bff7432f99'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:14:49.914992 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-dbfd5a99-6a60-4f7f-9254-a948c3844757 req-283c1062-4cd5-40d2-81ca-35494daf73ea tempest-LiveMigrationTest-386991981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:14:49.938162 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-dbfd5a99-6a60-4f7f-9254-a948c3844757 req-283c1062-4cd5-40d2-81ca-35494daf73ea tempest-LiveMigrationTest-386991981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:14:49.968659 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-dbfd5a99-6a60-4f7f-9254-a948c3844757 req-283c1062-4cd5-40d2-81ca-35494daf73ea tempest-LiveMigrationTest-386991981 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:14:49.975764 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-dbfd5a99-6a60-4f7f-9254-a948c3844757 req-283c1062-4cd5-40d2-81ca-35494daf73ea tempest-LiveMigrationTest-386991981 None] Deleted volume successfully.
Apr 16 21:14:50.091083 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e5d760da-c4ce-4838-be40-4f61d76b9b46 tempest-LiveMigrationTest-386991981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:14:50.121491 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e5d760da-c4ce-4838-be40-4f61d76b9b46 tempest-LiveMigrationTest-386991981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:14:50.173360 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-e5d760da-c4ce-4838-be40-4f61d76b9b46 tempest-LiveMigrationTest-386991981 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:14:50.178218 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e5d760da-c4ce-4838-be40-4f61d76b9b46 tempest-LiveMigrationTest-386991981 None] Deleted volume successfully.
Apr 16 21:14:50.181876 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-dbfd5a99-6a60-4f7f-9254-a948c3844757 req-283c1062-4cd5-40d2-81ca-35494daf73ea tempest-LiveMigrationTest-386991981 None] Lock "b'cinder-e18c96ab-5353-4ef3-b372-c892883f3711-delete_volume'" released by "delete_volume" :: held 16.414s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:14:50.414287 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-e5d760da-c4ce-4838-be40-4f61d76b9b46 tempest-LiveMigrationTest-386991981 None] Lock "b'cinder-47811ce7-10e6-4421-b54d-89b4bcfc2df7-delete_volume'" released by "delete_volume" :: held 14.133s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:15:22.608496 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:15:22.609890 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:15:22.682734 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:15:22.756597 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:16:22.604923 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:16:22.606909 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:16:22.632547 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:16:22.698452 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:17:00.848603 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:17:00.895867 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Flow 'volume_create_manager' (423bae52-c227-4c1c-a718-ce1d9b15bd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:17:00.914897 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16bc5075-dff0-47af-9110-c5f9fc11c588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:17:00.939872 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16bc5075-dff0-47af-9110-c5f9fc11c588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2084470968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=54669e2d-9a4c-425d-8821-4c2e7cc2cddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff01c614d0ea4275b713b7e872342151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:17:01Z,use_quota=True,user_id='929bcf59f4fb4eb7a8b76809cce91e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:17:00.949047 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf58b71-b033-4a80-a931-16d190114e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:17:00.957240 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf58b71-b033-4a80-a931-16d190114e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:17:00.968505 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70bf1b7-74a3-4519-9063-eecb49f2a929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:17:00.974816 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70bf1b7-74a3-4519-9063-eecb49f2a929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54669e2d-9a4c-425d-8821-4c2e7cc2cddb', 'volume_name': 'volume-54669e2d-9a4c-425d-8821-4c2e7cc2cddb', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:17:00.981732 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42cfb894-61c3-45e5-bbab-b729c8055e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:17:00.986247 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42cfb894-61c3-45e5-bbab-b729c8055e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:17:00.991156 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988bcb08-c2dc-4752-96cf-f37075414e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:17:00.993958 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Volume 54669e2d-9a4c-425d-8821-4c2e7cc2cddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54669e2d-9a4c-425d-8821-4c2e7cc2cddb', 'volume_size': 1}
Apr 16 21:17:00.993958 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] creating volume 'volume-54669e2d-9a4c-425d-8821-4c2e7cc2cddb' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:17:00.994163 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:17:01.902881 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:17:01.903385 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:17:01.907590 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988bcb08-c2dc-4752-96cf-f37075414e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54669e2d-9a4c-425d-8821-4c2e7cc2cddb', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:17:01.913087 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882cdf04-63e1-4432-931e-fd615eb5e13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:17:01.966629 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Volume volume-54669e2d-9a4c-425d-8821-4c2e7cc2cddb (54669e2d-9a4c-425d-8821-4c2e7cc2cddb): created successfully
Apr 16 21:17:01.970571 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882cdf04-63e1-4432-931e-fd615eb5e13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:17:01.976933 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Flow 'volume_create_manager' (423bae52-c227-4c1c-a718-ce1d9b15bd01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:17:02.070423 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-da3ae39d-b758-4f3d-9061-b02261660fe7 tempest-ServerRescueNegativeTestJSON-1963714062 None] Created volume successfully.
Apr 16 21:17:22.607897 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:17:22.608741 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:17:22.691803 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:17:22.757851 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:17:23.735678 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:17:23.758422 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Flow 'volume_create_manager' (98b93505-85ec-4046-88a9-00df552aa3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:17:23.765457 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929b226f-9bc9-40e7-b9c6-5f24719730cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:17:23.781258 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929b226f-9bc9-40e7-b9c6-5f24719730cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1425168087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9687446e-2d63-4b79-8b0a-20abf71fe84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff01c614d0ea4275b713b7e872342151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:17:24Z,use_quota=True,user_id='929bcf59f4fb4eb7a8b76809cce91e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:17:23.786824 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190d30b2-1709-455f-b9c8-daf243b0e127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:17:23.791589 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190d30b2-1709-455f-b9c8-daf243b0e127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:17:23.796925 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed4d3e0-b7e1-46bf-85ed-bd45a5bfc976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:17:23.801059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed4d3e0-b7e1-46bf-85ed-bd45a5bfc976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9687446e-2d63-4b79-8b0a-20abf71fe84e', 'volume_name': 'volume-9687446e-2d63-4b79-8b0a-20abf71fe84e', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:17:23.809502 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aeea6dc-8f44-4a91-bc8b-8317551bb95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:17:23.813648 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aeea6dc-8f44-4a91-bc8b-8317551bb95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:17:23.818535 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b00847-41fe-4271-b4d6-0c6042f206fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:17:23.819666 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Volume 9687446e-2d63-4b79-8b0a-20abf71fe84e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9687446e-2d63-4b79-8b0a-20abf71fe84e', 'volume_size': 1}
Apr 16 21:17:23.820066 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] creating volume 'volume-9687446e-2d63-4b79-8b0a-20abf71fe84e' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:17:23.820757 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:17:25.034591 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:17:25.042218 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:17:25.046739 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b00847-41fe-4271-b4d6-0c6042f206fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9687446e-2d63-4b79-8b0a-20abf71fe84e', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:17:25.053429 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f55fb2-be98-49a2-8416-69a3c80a9a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:17:25.139021 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Volume volume-9687446e-2d63-4b79-8b0a-20abf71fe84e (9687446e-2d63-4b79-8b0a-20abf71fe84e): created successfully
Apr 16 21:17:25.143645 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f55fb2-be98-49a2-8416-69a3c80a9a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:17:25.149847 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Flow 'volume_create_manager' (98b93505-85ec-4046-88a9-00df552aa3e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:17:25.260954 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1b167d10-61c7-445a-b9aa-5a2d94a17ce1 tempest-ServerRescueNegativeTestJSON-1963714062 None] Created volume successfully.
Apr 16 21:18:18.945852 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:18:18.968423 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Flow 'volume_create_manager' (105c3ad6-8581-4970-9cd4-d7c054eea8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:18:18.975639 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af18e68-7f67-4e5c-9f25-65e0a279d5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:18.995132 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af18e68-7f67-4e5c-9f25-65e0a279d5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1334143832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1358f4d1-a8a7-4e32-a974-ba9661e73667,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71e1106d96d0482a852a85dbb858c37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:18:19Z,use_quota=True,user_id='dc0a5db4abbe4d35aa9c7390579e3995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:19.000981 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37d9b92-4fa4-45a2-8972-17c566f28227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:19.005182 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37d9b92-4fa4-45a2-8972-17c566f28227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:19.010381 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd58adb-b40a-4a04-8f2a-33af6d964373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:19.014509 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd58adb-b40a-4a04-8f2a-33af6d964373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1358f4d1-a8a7-4e32-a974-ba9661e73667', 'volume_name': 'volume-1358f4d1-a8a7-4e32-a974-ba9661e73667', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:19.019462 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89ba3ec-fe27-41ca-9d02-ef5fc6741e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:19.023405 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89ba3ec-fe27-41ca-9d02-ef5fc6741e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:19.028134 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8330d386-0c7d-4bd9-b936-160c2f025a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:19.029242 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Volume 1358f4d1-a8a7-4e32-a974-ba9661e73667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1358f4d1-a8a7-4e32-a974-ba9661e73667', 'volume_size': 1}
Apr 16 21:18:19.029900 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] creating volume 'volume-1358f4d1-a8a7-4e32-a974-ba9661e73667' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:18:19.030567 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:18:20.083912 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:18:20.084573 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:18:20.088041 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8330d386-0c7d-4bd9-b936-160c2f025a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1358f4d1-a8a7-4e32-a974-ba9661e73667', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:20.092731 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1f5444-eaab-41f0-8543-4646e9300399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:20.178379 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Volume volume-1358f4d1-a8a7-4e32-a974-ba9661e73667 (1358f4d1-a8a7-4e32-a974-ba9661e73667): created successfully
Apr 16 21:18:20.181987 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1f5444-eaab-41f0-8543-4646e9300399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:20.187578 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Flow 'volume_create_manager' (105c3ad6-8581-4970-9cd4-d7c054eea8f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:18:20.245788 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ad0fb9cd-1f52-451e-bfd0-5dfe1c3004d6 tempest-VolumesTestJSON-1786337923 None] Created volume successfully.
Apr 16 21:18:21.590942 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:18:21.610531 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Flow 'volume_create_manager' (2b86d62f-21f9-4928-b1fa-1cb7dbda9566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:18:21.617625 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa0da7d-184d-44bd-9681-ea5c795dd41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:21.633807 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa0da7d-184d-44bd-9681-ea5c795dd41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-68349788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3fa85617-9e0b-4a8d-9abf-149cf6fb9a11,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71e1106d96d0482a852a85dbb858c37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:18:21Z,use_quota=True,user_id='dc0a5db4abbe4d35aa9c7390579e3995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:21.639331 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f907b4-45eb-4199-a936-bd7a78712a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:21.643571 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f907b4-45eb-4199-a936-bd7a78712a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:21.648905 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c93ac38-f9a2-472c-b5c5-3207ae3ff86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:21.653073 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c93ac38-f9a2-472c-b5c5-3207ae3ff86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fa85617-9e0b-4a8d-9abf-149cf6fb9a11', 'volume_name': 'volume-3fa85617-9e0b-4a8d-9abf-149cf6fb9a11', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:21.658339 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b89f46-5e0f-42d1-815f-1486557f72b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:21.662410 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b89f46-5e0f-42d1-815f-1486557f72b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:21.667213 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2549ac6f-1785-4063-8160-f6204ac130af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:21.668366 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Volume 3fa85617-9e0b-4a8d-9abf-149cf6fb9a11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fa85617-9e0b-4a8d-9abf-149cf6fb9a11', 'volume_size': 1}
Apr 16 21:18:21.668778 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] creating volume 'volume-3fa85617-9e0b-4a8d-9abf-149cf6fb9a11' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:18:21.669444 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:18:22.609462 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:18:22.610099 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:18:22.613629 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2549ac6f-1785-4063-8160-f6204ac130af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fa85617-9e0b-4a8d-9abf-149cf6fb9a11', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:22.618562 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5e2c2c-0f44-4114-b428-4e9689aa749d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:22.622286 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:18:22.622955 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:18:22.679567 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:18:22.701792 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:18:22.754523 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Volume volume-3fa85617-9e0b-4a8d-9abf-149cf6fb9a11 (3fa85617-9e0b-4a8d-9abf-149cf6fb9a11): created successfully
Apr 16 21:18:22.758769 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5e2c2c-0f44-4114-b428-4e9689aa749d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:22.764604 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Flow 'volume_create_manager' (2b86d62f-21f9-4928-b1fa-1cb7dbda9566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:18:22.840684 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-92d9a4ff-6cb8-49b3-a117-6579389778a9 tempest-VolumesTestJSON-1786337923 None] Created volume successfully.
Apr 16 21:18:24.396510 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:18:24.416884 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Flow 'volume_create_manager' (ed1b614f-2759-4f3c-810c-bb1623d7ff18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:18:24.423656 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1b9053-2874-45b7-89f5-14d6938fde9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:24.438794 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1b9053-2874-45b7-89f5-14d6938fde9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1481099001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=bbb77aaa-e22d-449c-8093-4a2883627371,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71e1106d96d0482a852a85dbb858c37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:18:24Z,use_quota=True,user_id='dc0a5db4abbe4d35aa9c7390579e3995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:24.444793 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94c5e5b-d8a9-41f8-9994-dcd83163d9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:24.449056 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94c5e5b-d8a9-41f8-9994-dcd83163d9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:24.454328 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c787f4-7b13-4270-80ad-c4111a9ec2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:24.458408 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c787f4-7b13-4270-80ad-c4111a9ec2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbb77aaa-e22d-449c-8093-4a2883627371', 'volume_name': 'volume-bbb77aaa-e22d-449c-8093-4a2883627371', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:24.464037 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eeeff9e-b38b-4c48-93a1-da20d095d645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:24.467992 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eeeff9e-b38b-4c48-93a1-da20d095d645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:24.472907 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3f6215-5057-42a4-bcef-e5590cddf0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:24.474025 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Volume bbb77aaa-e22d-449c-8093-4a2883627371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbb77aaa-e22d-449c-8093-4a2883627371', 'volume_size': 1}
Apr 16 21:18:24.474419 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] creating volume 'volume-bbb77aaa-e22d-449c-8093-4a2883627371' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:18:24.475085 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:18:25.335612 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:18:25.336000 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:18:25.339817 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3f6215-5057-42a4-bcef-e5590cddf0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbb77aaa-e22d-449c-8093-4a2883627371', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:25.344523 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0adc1d-7079-4be8-8ef0-de8bb9fd2209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:18:25.429196 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Volume volume-bbb77aaa-e22d-449c-8093-4a2883627371 (bbb77aaa-e22d-449c-8093-4a2883627371): created successfully
Apr 16 21:18:25.432866 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0adc1d-7079-4be8-8ef0-de8bb9fd2209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:18:25.438601 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Flow 'volume_create_manager' (ed1b614f-2759-4f3c-810c-bb1623d7ff18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:18:25.532435 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-92a6985f-bb62-4980-acb7-db65dd9482d0 tempest-VolumesTestJSON-1786337923 None] Created volume successfully.
Apr 16 21:18:27.160509 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-cad4fbc0-1a94-47f3-a0e0-9225914ed6e0 tempest-VolumesTestJSON-1786337923 None] Lock "b'cinder-bbb77aaa-e22d-449c-8093-4a2883627371-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:18:27.223199 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cad4fbc0-1a94-47f3-a0e0-9225914ed6e0 tempest-VolumesTestJSON-1786337923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:18:27.469214 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cad4fbc0-1a94-47f3-a0e0-9225914ed6e0 tempest-VolumesTestJSON-1786337923 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:18:27.469563 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cad4fbc0-1a94-47f3-a0e0-9225914ed6e0 tempest-VolumesTestJSON-1786337923 None] Volume volume-bbb77aaa-e22d-449c-8093-4a2883627371 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:18:27.755717 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cad4fbc0-1a94-47f3-a0e0-9225914ed6e0 tempest-VolumesTestJSON-1786337923 None] deleting rbd volume volume-bbb77aaa-e22d-449c-8093-4a2883627371 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:18:33.235165 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-e89e1ac7-97b8-42f7-aebe-1dea5eda30c7 req-b6b4e705-de4a-4e3d-bd01-7c451cdb6ddb tempest-ServerRescueNegativeTestJSON-1963714062 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:18:34.165371 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-e89e1ac7-97b8-42f7-aebe-1dea5eda30c7 req-b6b4e705-de4a-4e3d-bd01-7c451cdb6ddb tempest-ServerRescueNegativeTestJSON-1963714062 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.930s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:18:34.166672 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-e89e1ac7-97b8-42f7-aebe-1dea5eda30c7 req-b6b4e705-de4a-4e3d-bd01-7c451cdb6ddb tempest-ServerRescueNegativeTestJSON-1963714062 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9687446e-2d63-4b79-8b0a-20abf71fe84e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '9687446e-2d63-4b79-8b0a-20abf71fe84e', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:18:34.230674 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-e89e1ac7-97b8-42f7-aebe-1dea5eda30c7 req-b6b4e705-de4a-4e3d-bd01-7c451cdb6ddb tempest-ServerRescueNegativeTestJSON-1963714062 None] Connection info returned from driver {'name': 'volumes/volume-9687446e-2d63-4b79-8b0a-20abf71fe84e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9687446e-2d63-4b79-8b0a-20abf71fe84e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'aa79a5c8-2eb9-4e3a-8124-ec8258c61eb4'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:18:34.361017 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-e89e1ac7-97b8-42f7-aebe-1dea5eda30c7 req-b6b4e705-de4a-4e3d-bd01-7c451cdb6ddb tempest-ServerRescueNegativeTestJSON-1963714062 None] attachment_update completed successfully.
Apr 16 21:18:34.875714 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-cad4fbc0-1a94-47f3-a0e0-9225914ed6e0 tempest-VolumesTestJSON-1786337923 None] Created reservations ['72887089-1054-4321-8497-76b7b6b6fc3c', 'bc968dd6-853c-4a55-acf7-347942452f19', 'bb49aca3-5824-47fd-a05c-25a43aa5df2c', '188c1d0d-bf4e-4b79-8330-350b7aeee151'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:18:35.053246 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cad4fbc0-1a94-47f3-a0e0-9225914ed6e0 tempest-VolumesTestJSON-1786337923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:18:35.087057 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cad4fbc0-1a94-47f3-a0e0-9225914ed6e0 tempest-VolumesTestJSON-1786337923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:18:35.124582 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-cad4fbc0-1a94-47f3-a0e0-9225914ed6e0 tempest-VolumesTestJSON-1786337923 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:18:35.130876 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cad4fbc0-1a94-47f3-a0e0-9225914ed6e0 tempest-VolumesTestJSON-1786337923 None] Deleted volume successfully.
Apr 16 21:18:35.195723 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-cad4fbc0-1a94-47f3-a0e0-9225914ed6e0 tempest-VolumesTestJSON-1786337923 None] Lock "b'cinder-bbb77aaa-e22d-449c-8093-4a2883627371-delete_volume'" released by "delete_volume" :: held 8.035s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:18:36.460804 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-acacd7aa-9f28-4a32-b83f-c1a9385bd8d5 tempest-VolumesTestJSON-1786337923 None] Lock "b'cinder-3fa85617-9e0b-4a8d-9abf-149cf6fb9a11-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:18:36.728199 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-acacd7aa-9f28-4a32-b83f-c1a9385bd8d5 tempest-VolumesTestJSON-1786337923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:18:37.109570 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-acacd7aa-9f28-4a32-b83f-c1a9385bd8d5 tempest-VolumesTestJSON-1786337923 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:18:37.110019 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-acacd7aa-9f28-4a32-b83f-c1a9385bd8d5 tempest-VolumesTestJSON-1786337923 None] Volume volume-3fa85617-9e0b-4a8d-9abf-149cf6fb9a11 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:18:37.327320 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-acacd7aa-9f28-4a32-b83f-c1a9385bd8d5 tempest-VolumesTestJSON-1786337923 None] deleting rbd volume volume-3fa85617-9e0b-4a8d-9abf-149cf6fb9a11 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:18:44.926933 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-acacd7aa-9f28-4a32-b83f-c1a9385bd8d5 tempest-VolumesTestJSON-1786337923 None] Created reservations ['d41d0b68-c4b0-4a5a-90e2-5cf7bfaeef9c', '6cde7c69-5423-40e6-9ffa-c25015cea2e7', 'fe458b58-f3f7-4222-a917-947c245eb867', 'b5ecabb5-2c50-4303-a02e-22c5777bd4db'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:18:45.173082 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-acacd7aa-9f28-4a32-b83f-c1a9385bd8d5 tempest-VolumesTestJSON-1786337923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:18:45.194539 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-acacd7aa-9f28-4a32-b83f-c1a9385bd8d5 tempest-VolumesTestJSON-1786337923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:18:45.216911 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-acacd7aa-9f28-4a32-b83f-c1a9385bd8d5 tempest-VolumesTestJSON-1786337923 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:18:45.221413 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-acacd7aa-9f28-4a32-b83f-c1a9385bd8d5 tempest-VolumesTestJSON-1786337923 None] Deleted volume successfully.
Apr 16 21:18:45.297678 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-acacd7aa-9f28-4a32-b83f-c1a9385bd8d5 tempest-VolumesTestJSON-1786337923 None] Lock "b'cinder-3fa85617-9e0b-4a8d-9abf-149cf6fb9a11-delete_volume'" released by "delete_volume" :: held 8.839s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:18:46.227001 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b1c474d6-f531-4d98-a603-4878bc02e432 tempest-VolumesTestJSON-1786337923 None] Lock "b'cinder-1358f4d1-a8a7-4e32-a974-ba9661e73667-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:18:46.309875 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b1c474d6-f531-4d98-a603-4878bc02e432 tempest-VolumesTestJSON-1786337923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:18:46.509648 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b1c474d6-f531-4d98-a603-4878bc02e432 tempest-VolumesTestJSON-1786337923 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:18:46.510314 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b1c474d6-f531-4d98-a603-4878bc02e432 tempest-VolumesTestJSON-1786337923 None] Volume volume-1358f4d1-a8a7-4e32-a974-ba9661e73667 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:18:46.772742 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b1c474d6-f531-4d98-a603-4878bc02e432 tempest-VolumesTestJSON-1786337923 None] deleting rbd volume volume-1358f4d1-a8a7-4e32-a974-ba9661e73667 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:18:52.663366 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-b1c474d6-f531-4d98-a603-4878bc02e432 tempest-VolumesTestJSON-1786337923 None] Created reservations ['9512cfd1-c62d-4187-8eba-bbcd5b48256e', '04b786a2-cb30-4be8-9e6e-0b798f46ce4b', '75988180-5358-449f-b6e2-5c9250c751c4', '11918d53-2645-42c8-b5c1-bace212463fe'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:18:52.824634 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b1c474d6-f531-4d98-a603-4878bc02e432 tempest-VolumesTestJSON-1786337923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:18:52.858762 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b1c474d6-f531-4d98-a603-4878bc02e432 tempest-VolumesTestJSON-1786337923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:18:52.896435 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-b1c474d6-f531-4d98-a603-4878bc02e432 tempest-VolumesTestJSON-1786337923 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:18:52.901458 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b1c474d6-f531-4d98-a603-4878bc02e432 tempest-VolumesTestJSON-1786337923 None] Deleted volume successfully.
Apr 16 21:18:52.982356 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b1c474d6-f531-4d98-a603-4878bc02e432 tempest-VolumesTestJSON-1786337923 None] Lock "b'cinder-1358f4d1-a8a7-4e32-a974-ba9661e73667-delete_volume'" released by "delete_volume" :: held 6.755s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:19:22.627225 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:19:22.639136 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:19:22.650961 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:19:22.738602 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:19:31.986440 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-cbfce7b0-b675-4ab1-a4bd-482c53768400 req-00c31908-93b6-4ac4-9796-6157557d6a3e tempest-ServerRescueNegativeTestJSON-1963714062 None] Terminate volume connection completed successfully.
Apr 16 21:19:31.986996 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-cbfce7b0-b675-4ab1-a4bd-482c53768400 req-00c31908-93b6-4ac4-9796-6157557d6a3e tempest-ServerRescueNegativeTestJSON-1963714062 None] Deleting attachment aa79a5c8-2eb9-4e3a-8124-ec8258c61eb4. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:19:35.036419 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:19:35.056379 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Flow 'volume_create_manager' (768bef69-98c8-42c4-a56b-d5b22478f07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:19:35.063573 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1032f7b4-96f4-4361-ae78-a5f133f0c364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:19:35.079415 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1032f7b4-96f4-4361-ae78-a5f133f0c364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1330691946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7abd27d9-5866-44e0-bd74-3021f6bf9989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3cbfdc065da4c4b9f599d9cdd99496d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:19:35Z,use_quota=True,user_id='7495514ac1444f17b2b0fe5b8ba534b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:19:35.084916 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edda865a-bfa9-4c30-b286-10bbdef3d027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:19:35.090059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edda865a-bfa9-4c30-b286-10bbdef3d027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:19:35.095435 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d30a44-8abe-411a-b0ff-b1b76bdaf919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:19:35.099705 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d30a44-8abe-411a-b0ff-b1b76bdaf919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7abd27d9-5866-44e0-bd74-3021f6bf9989', 'volume_name': 'volume-7abd27d9-5866-44e0-bd74-3021f6bf9989', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:19:35.104841 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b94a173-f33a-41db-8ee6-8af275503919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:19:35.108805 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b94a173-f33a-41db-8ee6-8af275503919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:19:35.113602 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9a4fed-dc31-4773-a650-12fbfb2fed2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:19:35.114701 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Volume 7abd27d9-5866-44e0-bd74-3021f6bf9989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7abd27d9-5866-44e0-bd74-3021f6bf9989', 'volume_size': 1}
Apr 16 21:19:35.115107 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] creating volume 'volume-7abd27d9-5866-44e0-bd74-3021f6bf9989' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:19:35.115904 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:19:36.192328 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:19:36.192948 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:19:36.196775 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9a4fed-dc31-4773-a650-12fbfb2fed2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7abd27d9-5866-44e0-bd74-3021f6bf9989', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:19:36.202116 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e313d4-2b01-4647-8cd3-f0c11c27404a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:19:36.326315 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Volume volume-7abd27d9-5866-44e0-bd74-3021f6bf9989 (7abd27d9-5866-44e0-bd74-3021f6bf9989): created successfully
Apr 16 21:19:36.330300 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e313d4-2b01-4647-8cd3-f0c11c27404a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:19:36.336052 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Flow 'volume_create_manager' (768bef69-98c8-42c4-a56b-d5b22478f07b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:19:36.420531 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-01f37390-9fc8-43b5-abb3-b9a07cd23bfc tempest-VolumesAdminNegativeTest-521471108 None] Created volume successfully.
Apr 16 21:19:38.241717 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-cdc0667a-2e28-441c-b489-57bc0606b20f req-b683ecbe-cae8-439d-a58a-14d924ec9bf4 tempest-VolumesAdminNegativeTest-521471108 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:19:39.122104 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-cdc0667a-2e28-441c-b489-57bc0606b20f req-b683ecbe-cae8-439d-a58a-14d924ec9bf4 tempest-VolumesAdminNegativeTest-521471108 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.880s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:19:39.123263 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-cdc0667a-2e28-441c-b489-57bc0606b20f req-b683ecbe-cae8-439d-a58a-14d924ec9bf4 tempest-VolumesAdminNegativeTest-521471108 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7abd27d9-5866-44e0-bd74-3021f6bf9989', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '7abd27d9-5866-44e0-bd74-3021f6bf9989', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:19:39.264032 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-cdc0667a-2e28-441c-b489-57bc0606b20f req-b683ecbe-cae8-439d-a58a-14d924ec9bf4 tempest-VolumesAdminNegativeTest-521471108 None] Connection info returned from driver {'name': 'volumes/volume-7abd27d9-5866-44e0-bd74-3021f6bf9989', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7abd27d9-5866-44e0-bd74-3021f6bf9989', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '11188265-df8a-4688-a876-911950718dd3'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:19:39.423404 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-cdc0667a-2e28-441c-b489-57bc0606b20f req-b683ecbe-cae8-439d-a58a-14d924ec9bf4 tempest-VolumesAdminNegativeTest-521471108 None] attachment_update completed successfully.
Apr 16 21:19:41.855823 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0e244438-e0e5-40c6-84c1-216379f6c43b tempest-ServerRescueNegativeTestJSON-1963714062 None] Lock "b'cinder-9687446e-2d63-4b79-8b0a-20abf71fe84e-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:19:41.965099 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0e244438-e0e5-40c6-84c1-216379f6c43b tempest-ServerRescueNegativeTestJSON-1963714062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:19:42.215074 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0e244438-e0e5-40c6-84c1-216379f6c43b tempest-ServerRescueNegativeTestJSON-1963714062 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:19:42.216372 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0e244438-e0e5-40c6-84c1-216379f6c43b tempest-ServerRescueNegativeTestJSON-1963714062 None] Volume volume-9687446e-2d63-4b79-8b0a-20abf71fe84e is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:19:42.475922 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0e244438-e0e5-40c6-84c1-216379f6c43b tempest-ServerRescueNegativeTestJSON-1963714062 None] deleting rbd volume volume-9687446e-2d63-4b79-8b0a-20abf71fe84e {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:19:43.969910 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-ee51cea8-bcaf-440a-9089-859b0ab67329 req-58ddeb44-1db6-46da-886c-774c16924f9f tempest-VolumesAdminNegativeTest-521471108 None] Terminate volume connection completed successfully.
Apr 16 21:19:43.970579 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-ee51cea8-bcaf-440a-9089-859b0ab67329 req-58ddeb44-1db6-46da-886c-774c16924f9f tempest-VolumesAdminNegativeTest-521471108 None] Deleting attachment 11188265-df8a-4688-a876-911950718dd3. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:19:45.169767 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:19:45.193465 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Flow 'volume_create_manager' (bf9845a9-ff43-45ca-8397-abd8e49a2058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:19:45.201438 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c08e1a0-3681-43a6-9705-2767e4e3d69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:19:45.217567 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c08e1a0-3681-43a6-9705-2767e4e3d69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-823244741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=904b1c55-3b2a-45e4-bc6c-e20877b1f4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3cbfdc065da4c4b9f599d9cdd99496d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:19:45Z,use_quota=True,user_id='7495514ac1444f17b2b0fe5b8ba534b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:19:45.224335 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d81cbe-80ce-4d18-95cf-d998e26c016c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:19:45.228601 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d81cbe-80ce-4d18-95cf-d998e26c016c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:19:45.234098 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef522aca-1e83-4d2f-8d90-96ad0e30fdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:19:45.238252 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef522aca-1e83-4d2f-8d90-96ad0e30fdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '904b1c55-3b2a-45e4-bc6c-e20877b1f4f9', 'volume_name': 'volume-904b1c55-3b2a-45e4-bc6c-e20877b1f4f9', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:19:45.243425 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd6f2fc-8fed-47d2-98b4-6c089e3b1d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:19:45.248027 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd6f2fc-8fed-47d2-98b4-6c089e3b1d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:19:45.253029 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd1194ba-9eb7-4445-9d09-fedd6488a79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:19:45.254120 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Volume 904b1c55-3b2a-45e4-bc6c-e20877b1f4f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-904b1c55-3b2a-45e4-bc6c-e20877b1f4f9', 'volume_size': 1}
Apr 16 21:19:45.254528 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] creating volume 'volume-904b1c55-3b2a-45e4-bc6c-e20877b1f4f9' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:19:45.255207 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:19:46.284399 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:19:46.289436 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:19:46.292946 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd1194ba-9eb7-4445-9d09-fedd6488a79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-904b1c55-3b2a-45e4-bc6c-e20877b1f4f9', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:19:46.298378 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c58c3e-778a-4cd6-ae51-06314f1729e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:19:46.394748 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Volume volume-904b1c55-3b2a-45e4-bc6c-e20877b1f4f9 (904b1c55-3b2a-45e4-bc6c-e20877b1f4f9): created successfully
Apr 16 21:19:46.398596 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c58c3e-778a-4cd6-ae51-06314f1729e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:19:46.405572 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Flow 'volume_create_manager' (bf9845a9-ff43-45ca-8397-abd8e49a2058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:19:46.508756 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0029c62c-bd92-4b7f-894b-b696a1122942 tempest-VolumesAdminNegativeTest-521471108 None] Created volume successfully.
Apr 16 21:19:47.257189 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9354527f-0175-4c49-9258-5817e3444ad3 tempest-VolumesAdminNegativeTest-521471108 None] Lock "b'cinder-904b1c55-3b2a-45e4-bc6c-e20877b1f4f9-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:19:47.378135 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9354527f-0175-4c49-9258-5817e3444ad3 tempest-VolumesAdminNegativeTest-521471108 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:19:47.663459 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9354527f-0175-4c49-9258-5817e3444ad3 tempest-VolumesAdminNegativeTest-521471108 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:19:47.663985 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9354527f-0175-4c49-9258-5817e3444ad3 tempest-VolumesAdminNegativeTest-521471108 None] Volume volume-904b1c55-3b2a-45e4-bc6c-e20877b1f4f9 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:19:47.967445 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9354527f-0175-4c49-9258-5817e3444ad3 tempest-VolumesAdminNegativeTest-521471108 None] deleting rbd volume volume-904b1c55-3b2a-45e4-bc6c-e20877b1f4f9 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:19:49.777970 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-0e244438-e0e5-40c6-84c1-216379f6c43b tempest-ServerRescueNegativeTestJSON-1963714062 None] Created reservations ['9e5641a5-7a8d-4344-ab32-bb80d495d531', 'ae67100f-1d96-4214-8a63-7e143b6a02f0', '9df1710c-25fc-4cd1-9708-b321a2b6c6e0', '03ce531a-69ec-4f9e-af3c-0e501c786894'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:19:49.973005 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0e244438-e0e5-40c6-84c1-216379f6c43b tempest-ServerRescueNegativeTestJSON-1963714062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:19:50.023726 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0e244438-e0e5-40c6-84c1-216379f6c43b tempest-ServerRescueNegativeTestJSON-1963714062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:19:50.100009 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-0e244438-e0e5-40c6-84c1-216379f6c43b tempest-ServerRescueNegativeTestJSON-1963714062 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:19:50.106344 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0e244438-e0e5-40c6-84c1-216379f6c43b tempest-ServerRescueNegativeTestJSON-1963714062 None] Deleted volume successfully.
Apr 16 21:19:50.217503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0e244438-e0e5-40c6-84c1-216379f6c43b tempest-ServerRescueNegativeTestJSON-1963714062 None] Lock "b'cinder-9687446e-2d63-4b79-8b0a-20abf71fe84e-delete_volume'" released by "delete_volume" :: held 8.362s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:19:50.704730 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-6d68a6ae-c86c-480e-b4b0-3ba57e4eaba8 tempest-ServerRescueNegativeTestJSON-1963714062 None] Lock "b'cinder-54669e2d-9a4c-425d-8821-4c2e7cc2cddb-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:19:50.819450 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6d68a6ae-c86c-480e-b4b0-3ba57e4eaba8 tempest-ServerRescueNegativeTestJSON-1963714062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:19:51.011709 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6d68a6ae-c86c-480e-b4b0-3ba57e4eaba8 tempest-ServerRescueNegativeTestJSON-1963714062 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:19:51.012295 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6d68a6ae-c86c-480e-b4b0-3ba57e4eaba8 tempest-ServerRescueNegativeTestJSON-1963714062 None] Volume volume-54669e2d-9a4c-425d-8821-4c2e7cc2cddb is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:19:51.277225 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6d68a6ae-c86c-480e-b4b0-3ba57e4eaba8 tempest-ServerRescueNegativeTestJSON-1963714062 None] deleting rbd volume volume-54669e2d-9a4c-425d-8821-4c2e7cc2cddb {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:19:55.937534 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-9354527f-0175-4c49-9258-5817e3444ad3 tempest-VolumesAdminNegativeTest-521471108 None] Created reservations ['2135fc6c-6a81-4ad1-8a7b-e8541c5a4094', '2fa668fc-4a27-43b1-b293-44e65e900f0d', '3dfc6957-72e9-442d-9963-4dc18bd2ce4a', '1e26ab92-b6b5-440e-9210-bf83cfb7e6a2'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:19:56.149633 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9354527f-0175-4c49-9258-5817e3444ad3 tempest-VolumesAdminNegativeTest-521471108 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:19:56.201602 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9354527f-0175-4c49-9258-5817e3444ad3 tempest-VolumesAdminNegativeTest-521471108 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:19:56.286395 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-9354527f-0175-4c49-9258-5817e3444ad3 tempest-VolumesAdminNegativeTest-521471108 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:19:56.297697 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9354527f-0175-4c49-9258-5817e3444ad3 tempest-VolumesAdminNegativeTest-521471108 None] Deleted volume successfully.
Apr 16 21:19:56.399271 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9354527f-0175-4c49-9258-5817e3444ad3 tempest-VolumesAdminNegativeTest-521471108 None] Lock "b'cinder-904b1c55-3b2a-45e4-bc6c-e20877b1f4f9-delete_volume'" released by "delete_volume" :: held 9.142s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:19:57.204595 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-90f1a311-2948-4240-b048-dad6771952a2 tempest-VolumesAdminNegativeTest-521471108 None] Lock "b'cinder-7abd27d9-5866-44e0-bd74-3021f6bf9989-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:19:57.410672 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-90f1a311-2948-4240-b048-dad6771952a2 tempest-VolumesAdminNegativeTest-521471108 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:19:57.648028 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-90f1a311-2948-4240-b048-dad6771952a2 tempest-VolumesAdminNegativeTest-521471108 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:19:57.648542 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-90f1a311-2948-4240-b048-dad6771952a2 tempest-VolumesAdminNegativeTest-521471108 None] Volume volume-7abd27d9-5866-44e0-bd74-3021f6bf9989 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:19:57.916727 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-90f1a311-2948-4240-b048-dad6771952a2 tempest-VolumesAdminNegativeTest-521471108 None] deleting rbd volume volume-7abd27d9-5866-44e0-bd74-3021f6bf9989 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:20:00.298119 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-6d68a6ae-c86c-480e-b4b0-3ba57e4eaba8 tempest-ServerRescueNegativeTestJSON-1963714062 None] Created reservations ['b6848087-3282-4065-9c6e-29d3b54deee4', '2d5ba827-d344-4a71-8cf6-194f501e3218', '28800d5c-b70f-454a-8b8e-aba9b6ae9065', 'e71b87c5-5a40-4aac-9cff-891a246f5082'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:20:00.493927 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6d68a6ae-c86c-480e-b4b0-3ba57e4eaba8 tempest-ServerRescueNegativeTestJSON-1963714062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:20:00.574877 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6d68a6ae-c86c-480e-b4b0-3ba57e4eaba8 tempest-ServerRescueNegativeTestJSON-1963714062 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:20:00.646809 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-6d68a6ae-c86c-480e-b4b0-3ba57e4eaba8 tempest-ServerRescueNegativeTestJSON-1963714062 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:20:00.646809 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6d68a6ae-c86c-480e-b4b0-3ba57e4eaba8 tempest-ServerRescueNegativeTestJSON-1963714062 None] Deleted volume successfully.
Apr 16 21:20:00.787579 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-6d68a6ae-c86c-480e-b4b0-3ba57e4eaba8 tempest-ServerRescueNegativeTestJSON-1963714062 None] Lock "b'cinder-54669e2d-9a4c-425d-8821-4c2e7cc2cddb-delete_volume'" released by "delete_volume" :: held 10.083s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:20:05.938059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-90f1a311-2948-4240-b048-dad6771952a2 tempest-VolumesAdminNegativeTest-521471108 None] Created reservations ['d4395980-b681-4d13-be15-cf833fe4f710', '0ff8f62f-a698-46df-b277-a124b635fd74', '0509b3d8-5557-440e-8538-9c7c5ff74771', '42c46914-4d0d-457c-90d7-41d2f28d682f'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:20:06.105112 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-90f1a311-2948-4240-b048-dad6771952a2 tempest-VolumesAdminNegativeTest-521471108 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:20:06.161435 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-90f1a311-2948-4240-b048-dad6771952a2 tempest-VolumesAdminNegativeTest-521471108 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:20:06.210847 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-90f1a311-2948-4240-b048-dad6771952a2 tempest-VolumesAdminNegativeTest-521471108 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:20:06.227106 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-90f1a311-2948-4240-b048-dad6771952a2 tempest-VolumesAdminNegativeTest-521471108 None] Deleted volume successfully.
Apr 16 21:20:06.333600 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-90f1a311-2948-4240-b048-dad6771952a2 tempest-VolumesAdminNegativeTest-521471108 None] Lock "b'cinder-7abd27d9-5866-44e0-bd74-3021f6bf9989-delete_volume'" released by "delete_volume" :: held 9.130s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:20:22.626681 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:20:22.628925 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:20:22.693061 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:20:22.751902 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:20:59.067041 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 req-44a02c43-b958-4669-b526-14efc216418a tempest-ServersTestBootFromVolume-1004751907 None] Terminate volume connection completed successfully.
Apr 16 21:20:59.067976 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 req-44a02c43-b958-4669-b526-14efc216418a tempest-ServersTestBootFromVolume-1004751907 None] Deleting attachment d104ab34-695d-493d-84f7-7428eed2c0b7. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:20:59.756960 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 req-110465e2-95a3-4eb7-8227-76a596c6912f tempest-ServersTestBootFromVolume-1004751907 None] Lock "b'cinder-1706c0a9-c59e-4441-98fb-6e924e9769cf-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:20:59.892919 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 req-110465e2-95a3-4eb7-8227-76a596c6912f tempest-ServersTestBootFromVolume-1004751907 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:21:00.189876 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 req-110465e2-95a3-4eb7-8227-76a596c6912f tempest-ServersTestBootFromVolume-1004751907 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:21:00.459694 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 req-110465e2-95a3-4eb7-8227-76a596c6912f tempest-ServersTestBootFromVolume-1004751907 None] deleting rbd volume volume-1706c0a9-c59e-4441-98fb-6e924e9769cf {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:21:08.980880 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 req-110465e2-95a3-4eb7-8227-76a596c6912f tempest-ServersTestBootFromVolume-1004751907 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:21:09.196505 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 req-110465e2-95a3-4eb7-8227-76a596c6912f tempest-ServersTestBootFromVolume-1004751907 None] deleting parent snapshot volume-1706c0a9-c59e-4441-98fb-6e924e9769cf.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:21:13.418134 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 req-110465e2-95a3-4eb7-8227-76a596c6912f tempest-ServersTestBootFromVolume-1004751907 None] Created reservations ['3fa3a3e7-039d-4c3c-8949-2470dcad8783', '588919bf-16b8-4b90-895a-d58ad32a8bf9', '0dab6163-8a4f-4ddf-9337-b4f0e23a0b4f', '666ffde0-8ba3-4815-ad86-7bd405c57c59'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:21:13.737814 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 req-110465e2-95a3-4eb7-8227-76a596c6912f tempest-ServersTestBootFromVolume-1004751907 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:21:13.788875 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 req-110465e2-95a3-4eb7-8227-76a596c6912f tempest-ServersTestBootFromVolume-1004751907 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:21:13.832784 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 req-110465e2-95a3-4eb7-8227-76a596c6912f tempest-ServersTestBootFromVolume-1004751907 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:21:13.844200 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 req-110465e2-95a3-4eb7-8227-76a596c6912f tempest-ServersTestBootFromVolume-1004751907 None] Deleted volume successfully.
Apr 16 21:21:13.950009 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 req-110465e2-95a3-4eb7-8227-76a596c6912f tempest-ServersTestBootFromVolume-1004751907 None] Lock "b'cinder-1706c0a9-c59e-4441-98fb-6e924e9769cf-delete_volume'" released by "delete_volume" :: held 14.193s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:21:22.627232 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:21:22.631927 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:21:22.690706 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:21:22.757511 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:22:21.728298 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:22:21.785872 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Flow 'volume_create_manager' (e87f3af7-5632-4e3f-9a24-5c06a6d7a081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:22:21.800380 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e764ab9c-558d-4c2f-b479-b2d7dbce8f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:21.848212 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e764ab9c-558d-4c2f-b479-b2d7dbce8f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-371559293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0762402c-a0d6-4894-bf49-142a2b216d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8548f70297f04c1489783de67671dba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:22:22Z,use_quota=True,user_id='aa437260d34444efa2cef4ea34f57a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:21.883499 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd9e996-7d6b-4fac-98e0-c88f2fc65754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:21.895180 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd9e996-7d6b-4fac-98e0-c88f2fc65754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:21.909983 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4ee7d2-c204-45ec-a8f0-0d987540ff34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:22.097952 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4ee7d2-c204-45ec-a8f0-0d987540ff34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0762402c-a0d6-4894-bf49-142a2b216d88', 'volume_name': 'volume-0762402c-a0d6-4894-bf49-142a2b216d88', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710ac2fd0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:22.120756 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1fd5a6-6c7f-4384-b28e-484f2e3828d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:22.137185 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1fd5a6-6c7f-4384-b28e-484f2e3828d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:22.151677 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75e976b-dd62-4795-8386-20bee4bb7236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:22.153364 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Volume 0762402c-a0d6-4894-bf49-142a2b216d88: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0762402c-a0d6-4894-bf49-142a2b216d88', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710ac2fd0>}
Apr 16 21:22:22.157942 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Cloning 0762402c-a0d6-4894-bf49-142a2b216d88 from image 88bbe9a7-19d2-4102-9634-058b7c590848  at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 16 21:22:22.244385 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" acquired by "_prepare_image_cache_entry" :: waited 0.084s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:22:22.345315 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 22, 22, 250475)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:22:22.345766 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:22:22.346172 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Found cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 16 21:22:22.353188 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:22:22.405728 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Flow 'volume_create_manager' (fa4b2233-39dd-465c-a2f0-c035b1f3893e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:22:22.424006 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b39b5b9-cbb4-45f4-853a-1ce7e0728dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:22.470455 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b39b5b9-cbb4-45f4-853a-1ce7e0728dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-367008208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=75698430-ea32-4926-9b9e-e49021849330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cac90cc813744ac940a4d6d24d80d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:22:22Z,use_quota=True,user_id='5e85b38a9dfc434f8b36701c03b31cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:22.485762 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a33628-76c7-45f4-9fdf-fbe3be4da136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:22.499643 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a33628-76c7-45f4-9fdf-fbe3be4da136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:22.514145 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c9fd30-3c0a-46ac-a37b-c6b2706f9b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:22.531517 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c9fd30-3c0a-46ac-a37b-c6b2706f9b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75698430-ea32-4926-9b9e-e49021849330', 'volume_name': 'volume-75698430-ea32-4926-9b9e-e49021849330', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:22.545592 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49587ab7-abfe-4f6f-921f-c0d1175b6aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:22.555068 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49587ab7-abfe-4f6f-921f-c0d1175b6aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:22.569482 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9a69a2-cb8b-4f07-a818-7737a3e7f539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:22.571839 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Volume 75698430-ea32-4926-9b9e-e49021849330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75698430-ea32-4926-9b9e-e49021849330', 'volume_size': 1}
Apr 16 21:22:22.572434 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] creating volume 'volume-75698430-ea32-4926-9b9e-e49021849330' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:22:22.585819 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:22.652404 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:22:22.653519 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:22.742870 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:22.805184 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:22:22.811668 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" released by "_prepare_image_cache_entry" :: held 0.568s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:22:22.813099 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Attempting to retrieve cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 16 21:22:22.926511 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 22, 22, 821429)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:22:22.927546 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:22:22.928311 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Creating from source image-volume e0e222dd-75a5-4728-81e0-d352ad2a6247 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 16 21:22:22.960562 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:23.279111 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] creating snapshot='volume-0762402c-a0d6-4894-bf49-142a2b216d88.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:22:25.588492 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] cloning 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247@volume-0762402c-a0d6-4894-bf49-142a2b216d88.clone_snap' to 'volume-0762402c-a0d6-4894-bf49-142a2b216d88' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:22:25.624807 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:22:25.627419 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:22:25.636559 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9a69a2-cb8b-4f07-a818-7737a3e7f539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75698430-ea32-4926-9b9e-e49021849330', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:25.648084 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09a57e1-c5f1-4a57-a9d1-9af39a6b4306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:25.671758 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-4f386129-ef46-4d28-8047-7d089af441a4 req-101574fd-a9d5-4c12-9da0-9b3045ec2e9a tempest-TaggedBootDevicesTest-916837742 None] Terminate volume connection completed successfully.
Apr 16 21:22:25.672766 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-4f386129-ef46-4d28-8047-7d089af441a4 req-101574fd-a9d5-4c12-9da0-9b3045ec2e9a tempest-TaggedBootDevicesTest-916837742 None] Deleting attachment 679cdcdf-720b-4d09-84ec-b2597ea1047f. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:22:25.779214 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Volume volume-75698430-ea32-4926-9b9e-e49021849330 (75698430-ea32-4926-9b9e-e49021849330): created successfully
Apr 16 21:22:25.789892 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09a57e1-c5f1-4a57-a9d1-9af39a6b4306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:25.793437 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Flow 'volume_create_manager' (fa4b2233-39dd-465c-a2f0-c035b1f3893e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:22:25.898695 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e00dfa29-11b1-4309-8f49-df9decb7be35 tempest-VolumesTransfersV355Test-600705039 None] Created volume successfully.
Apr 16 21:22:26.870896 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:22:26.872659 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:22:26.873047 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:22:27.255923 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:22:27.258786 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Marking volume 0762402c-a0d6-4894-bf49-142a2b216d88 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:22:27.349034 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Copying metadata from image 88bbe9a7-19d2-4102-9634-058b7c590848 to 0762402c-a0d6-4894-bf49-142a2b216d88. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 16 21:22:27.349483 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Creating volume glance metadata for volume 0762402c-a0d6-4894-bf49-142a2b216d88 backed by image 88bbe9a7-19d2-4102-9634-058b7c590848 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 16 21:22:27.547213 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75e976b-dd62-4795-8386-20bee4bb7236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0762402c-a0d6-4894-bf49-142a2b216d88', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710ac2fd0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:27.552854 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44915d0-5155-4d07-ba13-770b351ded91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:27.656536 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Volume volume-0762402c-a0d6-4894-bf49-142a2b216d88 (0762402c-a0d6-4894-bf49-142a2b216d88): created successfully
Apr 16 21:22:27.661837 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44915d0-5155-4d07-ba13-770b351ded91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:27.670759 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Flow 'volume_create_manager' (e87f3af7-5632-4e3f-9a24-5c06a6d7a081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:22:27.720621 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-4f386129-ef46-4d28-8047-7d089af441a4 req-8ac82197-5446-4535-b653-d7303d348a3f tempest-TaggedBootDevicesTest-916837742 None] Terminate volume connection completed successfully.
Apr 16 21:22:27.721039 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-4f386129-ef46-4d28-8047-7d089af441a4 req-8ac82197-5446-4535-b653-d7303d348a3f tempest-TaggedBootDevicesTest-916837742 None] Deleting attachment 3cc0f3d8-17d6-4a17-a390-2c4e2e413956. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:22:27.785331 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ab954dfd-5000-4640-bc80-d6e4d8ab01c3 tempest-TaggedBootDevicesTest_v242-1122505264 None] Created volume successfully.
Apr 16 21:22:27.939149 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-4f386129-ef46-4d28-8047-7d089af441a4 req-611a0dcd-7af6-4ba4-9fd1-ce9c4cfa8f4d tempest-TaggedBootDevicesTest-916837742 None] Terminate volume connection completed successfully.
Apr 16 21:22:27.939820 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-4f386129-ef46-4d28-8047-7d089af441a4 req-611a0dcd-7af6-4ba4-9fd1-ce9c4cfa8f4d tempest-TaggedBootDevicesTest-916837742 None] Deleting attachment 655143f5-7614-4208-9b28-b57596c0ca79. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:22:28.188142 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e28cdb14-905a-4567-9e2a-23b4307473e9 tempest-VolumesTransfersV355Test-155897457 None] Transfer volume completed successfully.
Apr 16 21:22:29.344463 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:22:29.374104 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Flow 'volume_create_manager' (e54e35b2-5bd1-4a36-8ade-dba5a9e5d3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:22:29.383256 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffec3f6d-a2ec-4cdd-bd81-c0ff6dbf5b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:29.404818 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffec3f6d-a2ec-4cdd-bd81-c0ff6dbf5b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1175656102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8548f70297f04c1489783de67671dba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:22:29Z,use_quota=True,user_id='aa437260d34444efa2cef4ea34f57a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:29.412092 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4215ec-df83-4e8f-ab4e-631481fb4635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:29.418210 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4215ec-df83-4e8f-ab4e-631481fb4635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:29.425782 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bdb506-bad3-48f0-809f-25fa2cd1ba6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:29.433281 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bdb506-bad3-48f0-809f-25fa2cd1ba6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c', 'volume_name': 'volume-a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:29.438740 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28c5bac-31ee-4915-a59a-ff0d597325e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:29.444050 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28c5bac-31ee-4915-a59a-ff0d597325e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:29.452288 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2a6092-e645-4af1-910a-517461831c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:29.454094 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Volume a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c', 'volume_size': 1}
Apr 16 21:22:29.454686 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] creating volume 'volume-a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:22:29.455637 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:29.737509 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a968addc-b7e7-49a6-94df-e24d90ec29f0 tempest-VolumesTransfersV355Test-211647786 None] Lock "b'cinder-75698430-ea32-4926-9b9e-e49021849330-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:22:29.858355 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a968addc-b7e7-49a6-94df-e24d90ec29f0 tempest-VolumesTransfersV355Test-211647786 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:30.091564 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a968addc-b7e7-49a6-94df-e24d90ec29f0 tempest-VolumesTransfersV355Test-211647786 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:22:30.092733 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a968addc-b7e7-49a6-94df-e24d90ec29f0 tempest-VolumesTransfersV355Test-211647786 None] Volume volume-75698430-ea32-4926-9b9e-e49021849330 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:22:30.230272 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a968addc-b7e7-49a6-94df-e24d90ec29f0 tempest-VolumesTransfersV355Test-211647786 None] deleting rbd volume volume-75698430-ea32-4926-9b9e-e49021849330 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:22:30.242318 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:22:30.243064 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:22:30.256142 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2a6092-e645-4af1-910a-517461831c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:30.264196 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e772b3e2-de29-401d-90ed-762481fa6799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:30.377087 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Volume volume-a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c (a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c): created successfully
Apr 16 21:22:30.387700 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e772b3e2-de29-401d-90ed-762481fa6799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:30.403803 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Flow 'volume_create_manager' (e54e35b2-5bd1-4a36-8ade-dba5a9e5d3fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:22:30.543316 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0020a006-fa7e-46b2-ab1f-b3941de16891 tempest-TaggedBootDevicesTest_v242-1122505264 None] Created volume successfully.
Apr 16 21:22:32.339809 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:22:32.372309 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Flow 'volume_create_manager' (2559ee3d-be41-4c7d-ac9b-b5414136087c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:22:32.380105 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c773e18-8aa0-4098-88d4-253c6bbb9a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:32.402062 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c773e18-8aa0-4098-88d4-253c6bbb9a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-514973108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4bf759bc-60a0-4375-9c3a-38f91859fd27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8548f70297f04c1489783de67671dba2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:22:32Z,use_quota=True,user_id='aa437260d34444efa2cef4ea34f57a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:32.409921 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dadef6b7-6e57-434a-90ac-cea7e497ee67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:32.415978 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dadef6b7-6e57-434a-90ac-cea7e497ee67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:32.422507 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c72db17-92ec-4e55-8998-7a7f41c9c8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:32.432696 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c72db17-92ec-4e55-8998-7a7f41c9c8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bf759bc-60a0-4375-9c3a-38f91859fd27', 'volume_name': 'volume-4bf759bc-60a0-4375-9c3a-38f91859fd27', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:32.438094 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a147ae5b-ddf7-4568-93c8-957604d8539c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:32.443684 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a147ae5b-ddf7-4568-93c8-957604d8539c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:32.451495 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e826348f-e66a-456b-a08f-4c2c4cdc3724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:32.460609 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Volume 4bf759bc-60a0-4375-9c3a-38f91859fd27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bf759bc-60a0-4375-9c3a-38f91859fd27', 'volume_size': 1}
Apr 16 21:22:32.461030 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] creating volume 'volume-4bf759bc-60a0-4375-9c3a-38f91859fd27' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:22:32.461790 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:33.600969 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:22:33.603614 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:22:33.621740 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e826348f-e66a-456b-a08f-4c2c4cdc3724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bf759bc-60a0-4375-9c3a-38f91859fd27', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:33.646833 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c880e39f-2a77-430e-8c5e-a68e6139fc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:33.718892 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Volume volume-4bf759bc-60a0-4375-9c3a-38f91859fd27 (4bf759bc-60a0-4375-9c3a-38f91859fd27): created successfully
Apr 16 21:22:33.722995 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c880e39f-2a77-430e-8c5e-a68e6139fc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:33.729536 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Flow 'volume_create_manager' (2559ee3d-be41-4c7d-ac9b-b5414136087c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:22:33.787546 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-29164282-2cc0-4c6f-8046-144f28288267 tempest-TaggedBootDevicesTest_v242-1122505264 None] Created volume successfully.
Apr 16 21:22:34.800095 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-a968addc-b7e7-49a6-94df-e24d90ec29f0 tempest-VolumesTransfersV355Test-211647786 None] Created reservations ['1ac9d38b-51e7-48e3-9794-84bdb308ce5e', 'ee7b608b-c2a5-46d9-9b61-265a8543f649', 'c1d1113e-684f-47da-88e6-f698608d2808', 'b9951da0-cb61-411a-a1bf-7f6cba792e35'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:22:35.001256 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a968addc-b7e7-49a6-94df-e24d90ec29f0 tempest-VolumesTransfersV355Test-211647786 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:35.086823 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a968addc-b7e7-49a6-94df-e24d90ec29f0 tempest-VolumesTransfersV355Test-211647786 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:35.145497 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-a968addc-b7e7-49a6-94df-e24d90ec29f0 tempest-VolumesTransfersV355Test-211647786 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:22:35.151031 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a968addc-b7e7-49a6-94df-e24d90ec29f0 tempest-VolumesTransfersV355Test-211647786 None] Deleted volume successfully.
Apr 16 21:22:35.244331 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a968addc-b7e7-49a6-94df-e24d90ec29f0 tempest-VolumesTransfersV355Test-211647786 None] Lock "b'cinder-75698430-ea32-4926-9b9e-e49021849330-delete_volume'" released by "delete_volume" :: held 5.507s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:22:36.248758 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:22:36.296719 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Flow 'volume_create_manager' (b34a5b6e-555a-417c-a523-8a92c44f7163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:22:36.309838 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb111b05-f896-4a2b-80aa-786159e6a763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:36.332898 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb111b05-f896-4a2b-80aa-786159e6a763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1697788705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a4f2ec6a-7eba-48a9-9cdb-3da3fc47a5a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cac90cc813744ac940a4d6d24d80d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:22:36Z,use_quota=True,user_id='5e85b38a9dfc434f8b36701c03b31cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:36.343044 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170bf8fc-4f2f-429c-8860-0575d160128d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:36.349892 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170bf8fc-4f2f-429c-8860-0575d160128d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:36.357213 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f651e7c3-08b5-4af2-aadf-0c83728b55eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:36.363234 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f651e7c3-08b5-4af2-aadf-0c83728b55eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4f2ec6a-7eba-48a9-9cdb-3da3fc47a5a2', 'volume_name': 'volume-a4f2ec6a-7eba-48a9-9cdb-3da3fc47a5a2', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:36.371324 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa79580b-5387-4225-81fa-16127a672fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:36.377398 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa79580b-5387-4225-81fa-16127a672fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:36.386628 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ae2de4-a937-4e89-805a-94655cd1826d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:36.389341 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Volume a4f2ec6a-7eba-48a9-9cdb-3da3fc47a5a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4f2ec6a-7eba-48a9-9cdb-3da3fc47a5a2', 'volume_size': 1}
Apr 16 21:22:36.390760 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] creating volume 'volume-a4f2ec6a-7eba-48a9-9cdb-3da3fc47a5a2' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:22:36.391868 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:37.024509 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:22:37.025136 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:22:37.030993 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ae2de4-a937-4e89-805a-94655cd1826d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4f2ec6a-7eba-48a9-9cdb-3da3fc47a5a2', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:37.040161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe965a47-1498-4f4a-a6fb-85c8224a216a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:22:37.150705 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Volume volume-a4f2ec6a-7eba-48a9-9cdb-3da3fc47a5a2 (a4f2ec6a-7eba-48a9-9cdb-3da3fc47a5a2): created successfully
Apr 16 21:22:37.158147 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe965a47-1498-4f4a-a6fb-85c8224a216a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:22:37.169707 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Flow 'volume_create_manager' (b34a5b6e-555a-417c-a523-8a92c44f7163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:22:37.257716 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-aa592854-1706-40e9-9c4b-a50372f6d600 tempest-VolumesTransfersV355Test-600705039 None] Created volume successfully.
Apr 16 21:22:39.089001 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-652e0035-e12b-4994-9a2f-e9c4415a5f77 tempest-TaggedBootDevicesTest-916837742 None] Lock "b'cinder-7aad57cb-6f75-4d84-a883-22ddddb6aad5-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:22:39.216239 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-652e0035-e12b-4994-9a2f-e9c4415a5f77 tempest-TaggedBootDevicesTest-916837742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:39.390239 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-652e0035-e12b-4994-9a2f-e9c4415a5f77 tempest-TaggedBootDevicesTest-916837742 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:22:39.390681 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-652e0035-e12b-4994-9a2f-e9c4415a5f77 tempest-TaggedBootDevicesTest-916837742 None] Volume volume-7aad57cb-6f75-4d84-a883-22ddddb6aad5 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:22:39.511203 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-652e0035-e12b-4994-9a2f-e9c4415a5f77 tempest-TaggedBootDevicesTest-916837742 None] deleting rbd volume volume-7aad57cb-6f75-4d84-a883-22ddddb6aad5 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:22:39.559902 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-77fb8726-b6fb-4e50-81c9-8ca3d5ba57ba tempest-VolumesTransfersV355Test-211647786 None] Lock "b'cinder-a4f2ec6a-7eba-48a9-9cdb-3da3fc47a5a2-delete_volume'" acquired by "delete_volume" :: waited 0.040s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:22:39.712942 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-77fb8726-b6fb-4e50-81c9-8ca3d5ba57ba tempest-VolumesTransfersV355Test-211647786 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:40.125877 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-77fb8726-b6fb-4e50-81c9-8ca3d5ba57ba tempest-VolumesTransfersV355Test-211647786 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:22:40.127066 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-77fb8726-b6fb-4e50-81c9-8ca3d5ba57ba tempest-VolumesTransfersV355Test-211647786 None] Volume volume-a4f2ec6a-7eba-48a9-9cdb-3da3fc47a5a2 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:22:40.332208 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-77fb8726-b6fb-4e50-81c9-8ca3d5ba57ba tempest-VolumesTransfersV355Test-211647786 None] deleting rbd volume volume-a4f2ec6a-7eba-48a9-9cdb-3da3fc47a5a2 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:22:46.665642 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-652e0035-e12b-4994-9a2f-e9c4415a5f77 tempest-TaggedBootDevicesTest-916837742 None] Created reservations ['8f41d78a-01ea-4459-b864-6f671d4d4552', 'a16d9266-0a8e-4876-8bb8-5b2ecf1608a2', '68267111-2c53-49d2-bbf7-6ab7e03d7011', '10156cb7-cd1e-424c-90bf-8e2fa9c3491e'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:22:46.940993 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-652e0035-e12b-4994-9a2f-e9c4415a5f77 tempest-TaggedBootDevicesTest-916837742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:47.005342 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-652e0035-e12b-4994-9a2f-e9c4415a5f77 tempest-TaggedBootDevicesTest-916837742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:47.067102 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-652e0035-e12b-4994-9a2f-e9c4415a5f77 tempest-TaggedBootDevicesTest-916837742 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:22:47.109653 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-652e0035-e12b-4994-9a2f-e9c4415a5f77 tempest-TaggedBootDevicesTest-916837742 None] Deleted volume successfully.
Apr 16 21:22:47.243003 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-77fb8726-b6fb-4e50-81c9-8ca3d5ba57ba tempest-VolumesTransfersV355Test-211647786 None] Created reservations ['42ad3ff3-aaf8-4607-9717-ca4c064045e3', '7e157b27-c061-47b1-9222-642c9226d9c7', '8e0e536d-6195-4c42-98d6-a7b03a5b6316', 'c0aaea14-bc55-44b3-a2a7-c175cd7b7422'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:22:47.328617 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-e78848f1-7449-4b77-9b7a-9ffd14976899 tempest-TaggedBootDevicesTest-916837742 None] Lock "b'cinder-743c3f5e-43a6-4c29-bbca-fd48d7b20968-delete_volume'" acquired by "delete_volume" :: waited 0.133s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:22:47.405927 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-652e0035-e12b-4994-9a2f-e9c4415a5f77 tempest-TaggedBootDevicesTest-916837742 None] Lock "b'cinder-7aad57cb-6f75-4d84-a883-22ddddb6aad5-delete_volume'" released by "delete_volume" :: held 8.320s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:22:47.580082 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e78848f1-7449-4b77-9b7a-9ffd14976899 tempest-TaggedBootDevicesTest-916837742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:47.795926 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e78848f1-7449-4b77-9b7a-9ffd14976899 tempest-TaggedBootDevicesTest-916837742 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:22:47.796997 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e78848f1-7449-4b77-9b7a-9ffd14976899 tempest-TaggedBootDevicesTest-916837742 None] Volume volume-743c3f5e-43a6-4c29-bbca-fd48d7b20968 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:22:47.882638 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e78848f1-7449-4b77-9b7a-9ffd14976899 tempest-TaggedBootDevicesTest-916837742 None] deleting rbd volume volume-743c3f5e-43a6-4c29-bbca-fd48d7b20968 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:22:48.075494 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-77fb8726-b6fb-4e50-81c9-8ca3d5ba57ba tempest-VolumesTransfersV355Test-211647786 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:48.155704 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-77fb8726-b6fb-4e50-81c9-8ca3d5ba57ba tempest-VolumesTransfersV355Test-211647786 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:48.219244 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-77fb8726-b6fb-4e50-81c9-8ca3d5ba57ba tempest-VolumesTransfersV355Test-211647786 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:22:48.223395 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-77fb8726-b6fb-4e50-81c9-8ca3d5ba57ba tempest-VolumesTransfersV355Test-211647786 None] Deleted volume successfully.
Apr 16 21:22:48.377754 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-77fb8726-b6fb-4e50-81c9-8ca3d5ba57ba tempest-VolumesTransfersV355Test-211647786 None] Lock "b'cinder-a4f2ec6a-7eba-48a9-9cdb-3da3fc47a5a2-delete_volume'" released by "delete_volume" :: held 8.818s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:22:51.869169 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-e78848f1-7449-4b77-9b7a-9ffd14976899 tempest-TaggedBootDevicesTest-916837742 None] Created reservations ['91b035ff-5df0-42de-8530-9169d311835f', '422639de-06ee-4d75-92fb-183d2e466e7d', 'd6ac1ac9-5bc7-4c0a-9d02-deb727fa78be', '3587da7a-3246-4156-86ae-a22bf339895f'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:22:52.087347 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e78848f1-7449-4b77-9b7a-9ffd14976899 tempest-TaggedBootDevicesTest-916837742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:52.146066 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e78848f1-7449-4b77-9b7a-9ffd14976899 tempest-TaggedBootDevicesTest-916837742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:52.217936 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-e78848f1-7449-4b77-9b7a-9ffd14976899 tempest-TaggedBootDevicesTest-916837742 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:22:52.223491 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e78848f1-7449-4b77-9b7a-9ffd14976899 tempest-TaggedBootDevicesTest-916837742 None] Deleted volume successfully.
Apr 16 21:22:52.301079 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-e78848f1-7449-4b77-9b7a-9ffd14976899 tempest-TaggedBootDevicesTest-916837742 None] Lock "b'cinder-743c3f5e-43a6-4c29-bbca-fd48d7b20968-delete_volume'" released by "delete_volume" :: held 4.977s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:22:53.150807 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c27a23e4-8b20-45f0-951b-41c320d793b9 tempest-TaggedBootDevicesTest-916837742 None] Lock "b'cinder-00e6b7b1-560b-4bbb-b8e6-499709f33b8f-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:22:53.308917 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c27a23e4-8b20-45f0-951b-41c320d793b9 tempest-TaggedBootDevicesTest-916837742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:22:53.639640 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c27a23e4-8b20-45f0-951b-41c320d793b9 tempest-TaggedBootDevicesTest-916837742 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:22:53.841560 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c27a23e4-8b20-45f0-951b-41c320d793b9 tempest-TaggedBootDevicesTest-916837742 None] deleting rbd volume volume-00e6b7b1-560b-4bbb-b8e6-499709f33b8f {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:22:58.375121 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c27a23e4-8b20-45f0-951b-41c320d793b9 tempest-TaggedBootDevicesTest-916837742 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:22:58.548593 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c27a23e4-8b20-45f0-951b-41c320d793b9 tempest-TaggedBootDevicesTest-916837742 None] deleting parent snapshot volume-00e6b7b1-560b-4bbb-b8e6-499709f33b8f.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:23:01.181974 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-d010e609-74a2-4aa1-b034-962930eb76b3 req-7d27f59c-3e93-42dd-b8c4-4216f45406a8 tempest-TaggedBootDevicesTest_v242-1122505264 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:23:01.396033 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-c27a23e4-8b20-45f0-951b-41c320d793b9 tempest-TaggedBootDevicesTest-916837742 None] Created reservations ['e4044359-05b4-4d78-88f4-8577b7faae47', '53b9f2ab-caca-4bbe-8252-3d0cb5432c0d', 'c372531b-aae6-4a40-9200-4094213bbd60', '551c7005-e62f-41b8-8ca2-6425f72ebf93'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:23:01.432207 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:23:01.466409 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Flow 'volume_create_manager' (5320f698-70ce-4d30-a94f-1a75cc6ab35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:23:01.474228 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b0f005-93be-402f-935d-34332b209ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:23:01.497571 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b0f005-93be-402f-935d-34332b209ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2137376380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=aca3fc23-4db7-4546-a6eb-dbf395cd4a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d72b2bb3a304796bb144bc739ffcb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:23:01Z,use_quota=True,user_id='cf7ad620035e4c9f97da1a1b445437b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:23:01.503653 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c7096f-20b9-4a92-97f6-2314421d321c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:23:01.509371 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c7096f-20b9-4a92-97f6-2314421d321c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:23:01.515969 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832fa497-2240-45ab-bc4b-9c7d2c412ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:23:01.520718 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832fa497-2240-45ab-bc4b-9c7d2c412ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aca3fc23-4db7-4546-a6eb-dbf395cd4a3b', 'volume_name': 'volume-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:23:01.532949 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c9b195-c867-42e0-94ec-fa32c2da37d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:23:01.539136 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c9b195-c867-42e0-94ec-fa32c2da37d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:23:01.549018 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6171de91-0e17-4624-9162-a8d2835a30e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:23:01.550215 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Volume aca3fc23-4db7-4546-a6eb-dbf395cd4a3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b', 'volume_size': 1}
Apr 16 21:23:01.550649 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] creating volume 'volume-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:23:01.551887 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:23:01.743990 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c27a23e4-8b20-45f0-951b-41c320d793b9 tempest-TaggedBootDevicesTest-916837742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:23:01.827461 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c27a23e4-8b20-45f0-951b-41c320d793b9 tempest-TaggedBootDevicesTest-916837742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:23:01.899622 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-c27a23e4-8b20-45f0-951b-41c320d793b9 tempest-TaggedBootDevicesTest-916837742 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:23:01.904282 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c27a23e4-8b20-45f0-951b-41c320d793b9 tempest-TaggedBootDevicesTest-916837742 None] Deleted volume successfully.
Apr 16 21:23:01.997938 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c27a23e4-8b20-45f0-951b-41c320d793b9 tempest-TaggedBootDevicesTest-916837742 None] Lock "b'cinder-00e6b7b1-560b-4bbb-b8e6-499709f33b8f-delete_volume'" released by "delete_volume" :: held 8.847s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:23:02.157430 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:23:02.157815 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:23:02.161702 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6171de91-0e17-4624-9162-a8d2835a30e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:23:02.175626 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d834a159-6dd1-4670-be21-89571852d9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:23:02.274691 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Volume volume-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b (aca3fc23-4db7-4546-a6eb-dbf395cd4a3b): created successfully
Apr 16 21:23:02.279914 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d834a159-6dd1-4670-be21-89571852d9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:23:02.292215 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Flow 'volume_create_manager' (5320f698-70ce-4d30-a94f-1a75cc6ab35c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:23:02.380698 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1ab6b161-d262-48f9-966c-f725ab7513f9 tempest-VolumesActionsTest-311706575 None] Created volume successfully.
Apr 16 21:23:02.421764 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-d010e609-74a2-4aa1-b034-962930eb76b3 req-7d27f59c-3e93-42dd-b8c4-4216f45406a8 tempest-TaggedBootDevicesTest_v242-1122505264 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.242s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:23:02.422386 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-d010e609-74a2-4aa1-b034-962930eb76b3 req-7d27f59c-3e93-42dd-b8c4-4216f45406a8 tempest-TaggedBootDevicesTest_v242-1122505264 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0762402c-a0d6-4894-bf49-142a2b216d88', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '0762402c-a0d6-4894-bf49-142a2b216d88', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:23:02.509328 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-d010e609-74a2-4aa1-b034-962930eb76b3 req-7d27f59c-3e93-42dd-b8c4-4216f45406a8 tempest-TaggedBootDevicesTest_v242-1122505264 None] Connection info returned from driver {'name': 'volumes/volume-0762402c-a0d6-4894-bf49-142a2b216d88', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0762402c-a0d6-4894-bf49-142a2b216d88', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7320c8b0-1ef5-42ca-8412-3afe507a110b'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:23:02.677823 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-d010e609-74a2-4aa1-b034-962930eb76b3 req-7d27f59c-3e93-42dd-b8c4-4216f45406a8 tempest-TaggedBootDevicesTest_v242-1122505264 None] attachment_update completed successfully.
Apr 16 21:23:03.345259 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-d010e609-74a2-4aa1-b034-962930eb76b3 req-f9efdb59-ebc2-4bbf-93ee-f2570bd19d32 tempest-TaggedBootDevicesTest_v242-1122505264 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:23:04.232472 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-d010e609-74a2-4aa1-b034-962930eb76b3 req-f9efdb59-ebc2-4bbf-93ee-f2570bd19d32 tempest-TaggedBootDevicesTest_v242-1122505264 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.887s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:23:04.234880 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-d010e609-74a2-4aa1-b034-962930eb76b3 req-f9efdb59-ebc2-4bbf-93ee-f2570bd19d32 tempest-TaggedBootDevicesTest_v242-1122505264 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:23:04.303695 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-d010e609-74a2-4aa1-b034-962930eb76b3 req-f9efdb59-ebc2-4bbf-93ee-f2570bd19d32 tempest-TaggedBootDevicesTest_v242-1122505264 None] Connection info returned from driver {'name': 'volumes/volume-a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd5b52ac2-e5e5-43f2-951b-db37d4267d57'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:23:04.441364 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-d010e609-74a2-4aa1-b034-962930eb76b3 req-f9efdb59-ebc2-4bbf-93ee-f2570bd19d32 tempest-TaggedBootDevicesTest_v242-1122505264 None] attachment_update completed successfully.
Apr 16 21:23:05.145691 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-d010e609-74a2-4aa1-b034-962930eb76b3 req-522d4146-f610-42ee-bcc0-27100fd033cf tempest-TaggedBootDevicesTest_v242-1122505264 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:23:06.024560 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-d010e609-74a2-4aa1-b034-962930eb76b3 req-522d4146-f610-42ee-bcc0-27100fd033cf tempest-TaggedBootDevicesTest_v242-1122505264 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.879s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:23:06.027132 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-d010e609-74a2-4aa1-b034-962930eb76b3 req-522d4146-f610-42ee-bcc0-27100fd033cf tempest-TaggedBootDevicesTest_v242-1122505264 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4bf759bc-60a0-4375-9c3a-38f91859fd27', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '4bf759bc-60a0-4375-9c3a-38f91859fd27', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:23:06.143161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-d010e609-74a2-4aa1-b034-962930eb76b3 req-522d4146-f610-42ee-bcc0-27100fd033cf tempest-TaggedBootDevicesTest_v242-1122505264 None] Connection info returned from driver {'name': 'volumes/volume-4bf759bc-60a0-4375-9c3a-38f91859fd27', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4bf759bc-60a0-4375-9c3a-38f91859fd27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9b79335b-d0df-43cf-8de4-2f4ce53c3f8f'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:23:06.273742 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-d010e609-74a2-4aa1-b034-962930eb76b3 req-522d4146-f610-42ee-bcc0-27100fd033cf tempest-TaggedBootDevicesTest_v242-1122505264 None] attachment_update completed successfully.
Apr 16 21:23:22.657634 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:23:22.659387 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:23:22.786735 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:23:22.849617 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:23:28.481220 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-00cf610d-5755-4ff5-9d23-0c658a491045 tempest-VolumesActionsTest-311706575 None] Lock "b'cinder-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b'" acquired by "attach_volume" :: waited 0.015s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:23:28.800290 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-00cf610d-5755-4ff5-9d23-0c658a491045 tempest-VolumesActionsTest-311706575 None] Attaching volume aca3fc23-4db7-4546-a6eb-dbf395cd4a3b to instance 19297dff-d106-4813-8970-b6342085961c at mountpoint /dev/sdb on host None.
Apr 16 21:23:28.915332 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-00cf610d-5755-4ff5-9d23-0c658a491045 tempest-VolumesActionsTest-311706575 None] Attach volume completed successfully.
Apr 16 21:23:28.922485 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-00cf610d-5755-4ff5-9d23-0c658a491045 tempest-VolumesActionsTest-311706575 None] Lock "b'cinder-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b'" released by "attach_volume" :: held 0.441s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:23:29.081462 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8927c040-3c0f-4614-a7b6-257c3e06c112 tempest-VolumesActionsTest-311706575 None] Lock "b'cinder-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b-detach_volume'" acquired by "detach_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:23:29.082090 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8927c040-3c0f-4614-a7b6-257c3e06c112 tempest-VolumesActionsTest-311706575 None] Detaching volume aca3fc23-4db7-4546-a6eb-dbf395cd4a3b from instance 19297dff-d106-4813-8970-b6342085961c.
Apr 16 21:23:29.289633 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8927c040-3c0f-4614-a7b6-257c3e06c112 tempest-VolumesActionsTest-311706575 None] Detach volume completed successfully.
Apr 16 21:23:29.295259 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8927c040-3c0f-4614-a7b6-257c3e06c112 tempest-VolumesActionsTest-311706575 None] Lock "b'cinder-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b-detach_volume'" released by "detach_volume" :: held 0.214s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:23:47.713616 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:23:47.745989 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Flow 'volume_create_manager' (74baa560-d534-4c81-a88e-f72caefebbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:23:47.759387 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0cae7a3-ffa1-4039-ae8b-d61163147b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:23:47.782724 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0cae7a3-ffa1-4039-ae8b-d61163147b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-882071250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7caf6e59a47149a68cae6224fb2856e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:23:48Z,use_quota=True,user_id='e069f136dcb344b197f58ba47722f4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:23:47.794674 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89215332-98a7-4d17-82d0-4904f4b05f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:23:47.800512 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89215332-98a7-4d17-82d0-4904f4b05f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:23:47.825679 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6005ef08-e1c8-43c3-980b-2c3eb3f94023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:23:47.839820 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6005ef08-e1c8-43c3-980b-2c3eb3f94023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4', 'volume_name': 'volume-dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:23:47.847683 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdfd5447-b16a-40f9-b3f1-51f522c7ae8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:23:47.854867 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdfd5447-b16a-40f9-b3f1-51f522c7ae8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:23:47.860963 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046812b6-f89c-46a3-b35e-cb1e9a22554f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:23:47.866160 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Volume dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4', 'volume_size': 1}
Apr 16 21:23:47.866160 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] creating volume 'volume-dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:23:47.866160 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:23:48.458383 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:23:48.465958 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:23:48.465958 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046812b6-f89c-46a3-b35e-cb1e9a22554f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:23:48.471271 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596e21f1-d6c5-4814-9ff8-c336f2092544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:23:48.537246 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Volume volume-dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4 (dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4): created successfully
Apr 16 21:23:48.541166 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596e21f1-d6c5-4814-9ff8-c336f2092544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:23:48.547306 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Flow 'volume_create_manager' (74baa560-d534-4c81-a88e-f72caefebbaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:23:48.635471 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-62c8023a-1622-4c2a-b50f-accd4c900e77 tempest-DeleteServersTestJSON-2058819142 None] Created volume successfully.
Apr 16 21:23:50.534506 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-d2708744-bb8f-4666-80ab-4dc62d34f906 req-bc72f091-c3c1-423d-8cd6-46c6a9055357 tempest-DeleteServersTestJSON-2058819142 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:23:51.308383 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-d2708744-bb8f-4666-80ab-4dc62d34f906 req-bc72f091-c3c1-423d-8cd6-46c6a9055357 tempest-DeleteServersTestJSON-2058819142 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.773s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:23:51.309487 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-d2708744-bb8f-4666-80ab-4dc62d34f906 req-bc72f091-c3c1-423d-8cd6-46c6a9055357 tempest-DeleteServersTestJSON-2058819142 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:23:51.404091 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-d2708744-bb8f-4666-80ab-4dc62d34f906 req-bc72f091-c3c1-423d-8cd6-46c6a9055357 tempest-DeleteServersTestJSON-2058819142 None] Connection info returned from driver {'name': 'volumes/volume-dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7142de28-7689-41b6-bd5f-761d57fe7c1e'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:23:51.600359 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-d2708744-bb8f-4666-80ab-4dc62d34f906 req-bc72f091-c3c1-423d-8cd6-46c6a9055357 tempest-DeleteServersTestJSON-2058819142 None] attachment_update completed successfully.
Apr 16 21:23:54.088043 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-fdfcc4a5-700d-4d85-8727-ceb251b1ef54 tempest-VolumesActionsTest-311706575 None] Lock "b'cinder-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b'" acquired by "attach_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:23:54.325758 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fdfcc4a5-700d-4d85-8727-ceb251b1ef54 tempest-VolumesActionsTest-311706575 None] Attaching volume aca3fc23-4db7-4546-a6eb-dbf395cd4a3b to instance 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e at mountpoint /dev/sdb on host None.
Apr 16 21:23:54.412832 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fdfcc4a5-700d-4d85-8727-ceb251b1ef54 tempest-VolumesActionsTest-311706575 None] Attach volume completed successfully.
Apr 16 21:23:54.419228 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-fdfcc4a5-700d-4d85-8727-ceb251b1ef54 tempest-VolumesActionsTest-311706575 None] Lock "b'cinder-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b'" released by "attach_volume" :: held 0.331s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:23:54.582987 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5d939c57-25f5-44ad-965f-5b0a9859b4ec tempest-VolumesActionsTest-311706575 None] Lock "b'cinder-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:23:54.583510 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5d939c57-25f5-44ad-965f-5b0a9859b4ec tempest-VolumesActionsTest-311706575 None] Detaching volume aca3fc23-4db7-4546-a6eb-dbf395cd4a3b from instance 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e.
Apr 16 21:23:54.726915 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5d939c57-25f5-44ad-965f-5b0a9859b4ec tempest-VolumesActionsTest-311706575 None] Detach volume completed successfully.
Apr 16 21:23:54.731374 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5d939c57-25f5-44ad-965f-5b0a9859b4ec tempest-VolumesActionsTest-311706575 None] Lock "b'cinder-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b-detach_volume'" released by "detach_volume" :: held 0.148s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:23:58.783938 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-064c5483-fcc6-4f2b-a444-16f7559c60e7 req-c7df8f69-74be-4cdb-ac39-e8ed5e7b5b36 tempest-DeleteServersTestJSON-2058819142 None] Terminate volume connection completed successfully.
Apr 16 21:23:58.784659 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-064c5483-fcc6-4f2b-a444-16f7559c60e7 req-c7df8f69-74be-4cdb-ac39-e8ed5e7b5b36 tempest-DeleteServersTestJSON-2058819142 None] Deleting attachment 7142de28-7689-41b6-bd5f-761d57fe7c1e. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:24:01.860078 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-912aa8c6-7f33-4eac-8a64-9271a816bff4 tempest-VolumesActionsTest-311706575 None] Running cmd (subprocess): rbd export --pool volumes volume-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b /opt/stack/data/cinder/conversion/volume-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b-c6243917-a3f6-4a0c-8a14-042f0430ae68 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:24:02.719420 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-912aa8c6-7f33-4eac-8a64-9271a816bff4 tempest-VolumesActionsTest-311706575 None] CMD "rbd export --pool volumes volume-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b /opt/stack/data/cinder/conversion/volume-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b-c6243917-a3f6-4a0c-8a14-042f0430ae68 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.859s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:24:02.730663 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.image_utils [None req-912aa8c6-7f33-4eac-8a64-9271a816bff4 tempest-VolumesActionsTest-311706575 None] c6243917-a3f6-4a0c-8a14-042f0430ae68 was raw, no need to convert to raw {{(pid=130674) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}}
Apr 16 21:24:22.657682 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:24:22.658971 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:24:22.705441 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:24:22.786159 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:24:32.392968 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-912aa8c6-7f33-4eac-8a64-9271a816bff4 tempest-VolumesActionsTest-311706575 None] Uploaded volume to glance image-id: c6243917-a3f6-4a0c-8a14-042f0430ae68. {{(pid=130674) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1745}}
Apr 16 21:24:32.508609 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-912aa8c6-7f33-4eac-8a64-9271a816bff4 tempest-VolumesActionsTest-311706575 None] Copy volume to image completed successfully.
Apr 16 21:24:35.175547 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d8065f4c-e68d-4d9f-baa4-5e1ce97509a1 tempest-VolumesActionsTest-311706575 None] Lock "b'cinder-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:24:35.265431 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d8065f4c-e68d-4d9f-baa4-5e1ce97509a1 tempest-VolumesActionsTest-311706575 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:24:35.509095 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d8065f4c-e68d-4d9f-baa4-5e1ce97509a1 tempest-VolumesActionsTest-311706575 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:24:35.509541 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d8065f4c-e68d-4d9f-baa4-5e1ce97509a1 tempest-VolumesActionsTest-311706575 None] Volume volume-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:24:35.798821 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d8065f4c-e68d-4d9f-baa4-5e1ce97509a1 tempest-VolumesActionsTest-311706575 None] deleting rbd volume volume-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:24:43.795089 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-d8065f4c-e68d-4d9f-baa4-5e1ce97509a1 tempest-VolumesActionsTest-311706575 None] Created reservations ['5d45027c-b06b-4669-bc8c-5292ae7d1ba0', '05c8a310-6ccc-48be-8f94-2c0c07c4e0ed', '226e0cc8-c960-43f2-bcbb-d38c8223b6f5', 'a425b4b2-3bac-4238-8932-a8980a64da8c'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:24:44.012979 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d8065f4c-e68d-4d9f-baa4-5e1ce97509a1 tempest-VolumesActionsTest-311706575 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:24:44.053318 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d8065f4c-e68d-4d9f-baa4-5e1ce97509a1 tempest-VolumesActionsTest-311706575 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:24:44.158048 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d8065f4c-e68d-4d9f-baa4-5e1ce97509a1 tempest-VolumesActionsTest-311706575 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:24:44.166025 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d8065f4c-e68d-4d9f-baa4-5e1ce97509a1 tempest-VolumesActionsTest-311706575 None] Deleted volume successfully.
Apr 16 21:24:44.282542 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d8065f4c-e68d-4d9f-baa4-5e1ce97509a1 tempest-VolumesActionsTest-311706575 None] Lock "b'cinder-aca3fc23-4db7-4546-a6eb-dbf395cd4a3b-delete_volume'" released by "delete_volume" :: held 9.107s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:24:51.512351 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:24:51.540965 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Flow 'volume_create_manager' (e01ec0b1-da16-4aa9-a389-11f6cd3c27f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:24:51.547714 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60a59b7-d186-4449-ab9d-725d58b5b1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:24:51.591632 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60a59b7-d186-4449-ab9d-725d58b5b1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-367217535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c7950984-79c5-4c73-b6fd-6a85087a658e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f360e4398cb4a08a17e660194b6320a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:24:51Z,use_quota=True,user_id='97979cbad1b94141ab1311fefffcde0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:24:51.608190 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3362c9-ba74-4b33-ac23-5fafbf643ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:24:51.612883 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3362c9-ba74-4b33-ac23-5fafbf643ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:24:51.619056 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f743691c-5e24-469d-9bfd-a6e0ec9a6bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:24:51.739746 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f743691c-5e24-469d-9bfd-a6e0ec9a6bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c7950984-79c5-4c73-b6fd-6a85087a658e', 'volume_name': 'volume-c7950984-79c5-4c73-b6fd-6a85087a658e', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7127127f0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:24:51.750440 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560e7671-2d50-4b79-9be1-03280aa5e326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:24:51.754542 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560e7671-2d50-4b79-9be1-03280aa5e326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:24:51.760259 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98102088-5733-41b3-9199-69b27f044a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:24:51.761444 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Volume c7950984-79c5-4c73-b6fd-6a85087a658e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c7950984-79c5-4c73-b6fd-6a85087a658e', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7127127f0>}
Apr 16 21:24:51.762336 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Cloning c7950984-79c5-4c73-b6fd-6a85087a658e from image 88bbe9a7-19d2-4102-9634-058b7c590848  at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 16 21:24:51.771237 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:24:51.897236 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 24, 51, 775406)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:24:51.897671 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:24:51.898071 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Found cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 16 21:24:51.902873 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" released by "_prepare_image_cache_entry" :: held 0.132s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:24:51.903831 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Attempting to retrieve cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 16 21:24:51.909712 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 24, 51, 907468)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:24:51.910392 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:24:51.910820 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Creating from source image-volume e0e222dd-75a5-4728-81e0-d352ad2a6247 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 16 21:24:51.922582 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:24:52.255432 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] creating snapshot='volume-c7950984-79c5-4c73-b6fd-6a85087a658e.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:24:54.195370 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] cloning 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247@volume-c7950984-79c5-4c73-b6fd-6a85087a658e.clone_snap' to 'volume-c7950984-79c5-4c73-b6fd-6a85087a658e' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:24:56.348225 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:24:56.350564 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:24:56.351135 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:24:57.153182 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:24:57.153816 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Marking volume c7950984-79c5-4c73-b6fd-6a85087a658e as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:24:57.257347 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Copying metadata from image 88bbe9a7-19d2-4102-9634-058b7c590848 to c7950984-79c5-4c73-b6fd-6a85087a658e. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 16 21:24:57.257823 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Creating volume glance metadata for volume c7950984-79c5-4c73-b6fd-6a85087a658e backed by image 88bbe9a7-19d2-4102-9634-058b7c590848 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 16 21:24:57.385329 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98102088-5733-41b3-9199-69b27f044a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7950984-79c5-4c73-b6fd-6a85087a658e', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7127127f0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:24:57.390173 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a7d683-7b21-4c27-bec5-b567a2218a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:24:57.449379 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Volume volume-c7950984-79c5-4c73-b6fd-6a85087a658e (c7950984-79c5-4c73-b6fd-6a85087a658e): created successfully
Apr 16 21:24:57.453640 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a7d683-7b21-4c27-bec5-b567a2218a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:24:57.464728 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Flow 'volume_create_manager' (e01ec0b1-da16-4aa9-a389-11f6cd3c27f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:24:57.593735 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-97d50fa1-eb2f-428b-89e8-0e0be6341ee2 tempest-VolumesCloneTest-1802321178 None] Created volume successfully.
Apr 16 21:24:58.676047 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:24:58.763715 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Flow 'volume_create_manager' (d54f82ac-649e-4f1a-8679-87a4b58bf0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:24:58.783882 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da1a151-e3c1-4674-bb12-7ec018f3f625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:24:58.815431 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da1a151-e3c1-4674-bb12-7ec018f3f625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1701008476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2a3a2a7a-b1da-43cf-a2e6-1bb5ee0cdc8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f360e4398cb4a08a17e660194b6320a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=c7950984-79c5-4c73-b6fd-6a85087a658e,status='creating',terminated_at=None,updated_at=2022-04-16T21:24:58Z,use_quota=True,user_id='97979cbad1b94141ab1311fefffcde0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:24:58.825238 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f639ca9b-7998-4f9a-8236-468958c19929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:24:58.836810 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f639ca9b-7998-4f9a-8236-468958c19929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:24:58.839239 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cfceb5b-f7d0-4be2-850b-2e1066eedfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:24:58.857359 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cfceb5b-f7d0-4be2-850b-2e1066eedfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2a3a2a7a-b1da-43cf-a2e6-1bb5ee0cdc8c', 'volume_name': 'volume-2a3a2a7a-b1da-43cf-a2e6-1bb5ee0cdc8c', 'volume_size': 1, 'source_volid': 'c7950984-79c5-4c73-b6fd-6a85087a658e', 'source_volstatus': 'available'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:24:58.863232 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d40c2a7-7634-4e09-b263-a66c6438e75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:24:58.904999 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d40c2a7-7634-4e09-b263-a66c6438e75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:24:58.904999 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0535a642-1339-4c3c-aff6-5eee3e2e077e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:24:58.904999 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Volume 2a3a2a7a-b1da-43cf-a2e6-1bb5ee0cdc8c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2a3a2a7a-b1da-43cf-a2e6-1bb5ee0cdc8c', 'volume_size': 1, 'source_volid': 'c7950984-79c5-4c73-b6fd-6a85087a658e', 'source_volstatus': 'available'}
Apr 16 21:24:58.904999 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:24:59.428302 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] creating snapshot='volume-2a3a2a7a-b1da-43cf-a2e6-1bb5ee0cdc8c.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:25:01.964600 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] cloning 'volume-c7950984-79c5-4c73-b6fd-6a85087a658e@volume-2a3a2a7a-b1da-43cf-a2e6-1bb5ee0cdc8c.clone_snap' to 'volume-2a3a2a7a-b1da-43cf-a2e6-1bb5ee0cdc8c' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:25:03.302792 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:25:03.322933 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Flow 'volume_create_manager' (30a87219-ea7a-42d0-8a85-587f897a8cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:25:03.330362 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72cf2402-d6e4-4895-8eb8-f5684e4a0d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:03.351805 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72cf2402-d6e4-4895-8eb8-f5684e4a0d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1464065644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a89555a4-c1fe-4512-9779-1ac4ed29f291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f8dfa11e9b410cbbd59ffe32afeb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:25:03Z,use_quota=True,user_id='37443a4e933a4873bb039b06efaec98f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:03.354799 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9005be-970a-4b9e-87cc-59d2e19634a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:03.360680 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9005be-970a-4b9e-87cc-59d2e19634a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:03.366588 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4846248e-b6df-415d-ac25-8fbf4b2fb972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:03.370866 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4846248e-b6df-415d-ac25-8fbf4b2fb972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a89555a4-c1fe-4512-9779-1ac4ed29f291', 'volume_name': 'volume-a89555a4-c1fe-4512-9779-1ac4ed29f291', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:03.377045 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11baf253-2b30-4663-bb99-38e322c10ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:03.381596 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11baf253-2b30-4663-bb99-38e322c10ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:03.386991 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb42cfb-8b6b-4019-bcca-a62e92d9cc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:03.388105 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Volume a89555a4-c1fe-4512-9779-1ac4ed29f291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a89555a4-c1fe-4512-9779-1ac4ed29f291', 'volume_size': 1}
Apr 16 21:25:03.388520 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] creating volume 'volume-a89555a4-c1fe-4512-9779-1ac4ed29f291' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:25:03.389326 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:25:03.682197 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:25:03.707186 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Flow 'volume_create_manager' (ee3cd0db-faf0-4016-8c13-bd8d79e6bb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:25:03.715313 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61baeb5-1761-4396-9457-d57f7706e8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:03.732635 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61baeb5-1761-4396-9457-d57f7706e8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1008519579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=302aed6d-4327-400f-b1cc-7330052c22f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6dcd4e578e9420cb0aaa2dd0e43a280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:25:04Z,use_quota=True,user_id='61eb0141ef744beeb2b9e1a6f25958fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:03.739699 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bc2fb9-a7c9-46ee-9949-10fb1b81b7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:03.744439 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bc2fb9-a7c9-46ee-9949-10fb1b81b7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:03.750265 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd11f6f4-e99b-4266-a162-86bc5527ce7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:03.755341 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd11f6f4-e99b-4266-a162-86bc5527ce7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '302aed6d-4327-400f-b1cc-7330052c22f1', 'volume_name': 'volume-302aed6d-4327-400f-b1cc-7330052c22f1', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:03.760621 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a8a263-5f21-470b-b213-8d09c9056590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:03.764712 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a8a263-5f21-470b-b213-8d09c9056590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:03.769620 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351a324c-15d2-4a10-a18f-d350020f5cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:03.771774 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Volume 302aed6d-4327-400f-b1cc-7330052c22f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-302aed6d-4327-400f-b1cc-7330052c22f1', 'volume_size': 1}
Apr 16 21:25:03.772203 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] creating volume 'volume-302aed6d-4327-400f-b1cc-7330052c22f1' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:25:03.772884 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:25:04.256923 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:25:04.258737 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:25:04.259180 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:25:05.083425 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:25:05.084011 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Marking volume 2a3a2a7a-b1da-43cf-a2e6-1bb5ee0cdc8c as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:25:05.099509 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:25:05.100103 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:25:05.105728 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb42cfb-8b6b-4019-bcca-a62e92d9cc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a89555a4-c1fe-4512-9779-1ac4ed29f291', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:05.110924 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be65f4d7-8e28-4005-a6e8-e6a6de551c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:05.117724 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:25:05.118187 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:25:05.121982 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351a324c-15d2-4a10-a18f-d350020f5cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-302aed6d-4327-400f-b1cc-7330052c22f1', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:05.126671 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360e8225-bfe7-42b6-adc6-8ed285c165e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:05.206748 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Copying metadata from source volume c7950984-79c5-4c73-b6fd-6a85087a658e to 2a3a2a7a-b1da-43cf-a2e6-1bb5ee0cdc8c. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:436}}
Apr 16 21:25:05.209364 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Volume volume-a89555a4-c1fe-4512-9779-1ac4ed29f291 (a89555a4-c1fe-4512-9779-1ac4ed29f291): created successfully
Apr 16 21:25:05.214218 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be65f4d7-8e28-4005-a6e8-e6a6de551c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:05.226363 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Flow 'volume_create_manager' (30a87219-ea7a-42d0-8a85-587f897a8cfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:25:05.230897 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Volume volume-302aed6d-4327-400f-b1cc-7330052c22f1 (302aed6d-4327-400f-b1cc-7330052c22f1): created successfully
Apr 16 21:25:05.235184 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360e8225-bfe7-42b6-adc6-8ed285c165e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:05.242512 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Flow 'volume_create_manager' (ee3cd0db-faf0-4016-8c13-bd8d79e6bb34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:25:05.298172 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-04a519cc-246d-43db-b280-9387a234ce8f tempest-ServersNegativeTestJSON-1640489356 None] Created volume successfully.
Apr 16 21:25:05.344870 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4980e101-87db-4ffa-a877-0907c5aed82f tempest-AttachVolumeNegativeTest-1739448039 None] Created volume successfully.
Apr 16 21:25:05.386908 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0535a642-1339-4c3c-aff6-5eee3e2e077e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a3a2a7a-b1da-43cf-a2e6-1bb5ee0cdc8c', 'volume_size': 1, 'source_volid': 'c7950984-79c5-4c73-b6fd-6a85087a658e', 'source_volstatus': 'available'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:05.391618 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bda117-5621-4094-9b06-477fb98be3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:05.525507 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Volume volume-2a3a2a7a-b1da-43cf-a2e6-1bb5ee0cdc8c (2a3a2a7a-b1da-43cf-a2e6-1bb5ee0cdc8c): created successfully
Apr 16 21:25:05.534860 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bda117-5621-4094-9b06-477fb98be3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:05.544709 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Flow 'volume_create_manager' (d54f82ac-649e-4f1a-8679-87a4b58bf0fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:25:05.714228 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b9e622d3-fcee-4e07-95a0-8bdb077195b9 tempest-VolumesCloneTest-1802321178 None] Created volume successfully.
Apr 16 21:25:07.680619 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:25:07.702962 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Flow 'volume_create_manager' (c776ac83-af80-43c8-8450-40054023a413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:25:07.710406 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac129902-8694-4bdc-844d-9581f3bb1da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:07.727135 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac129902-8694-4bdc-844d-9581f3bb1da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-800739897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f560b40e-0e82-4a5d-9c45-a6fbb242d16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6dcd4e578e9420cb0aaa2dd0e43a280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:25:07Z,use_quota=True,user_id='61eb0141ef744beeb2b9e1a6f25958fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:07.733213 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c2cf28-373e-47e2-8602-d31c76ea3ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:07.738112 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c2cf28-373e-47e2-8602-d31c76ea3ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:07.743333 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7075e7f2-163e-4477-b841-8723161c293e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:07.747451 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7075e7f2-163e-4477-b841-8723161c293e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f560b40e-0e82-4a5d-9c45-a6fbb242d16d', 'volume_name': 'volume-f560b40e-0e82-4a5d-9c45-a6fbb242d16d', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:07.752488 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50714096-775f-4973-bd7e-c7d08c7c9520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:07.756892 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50714096-775f-4973-bd7e-c7d08c7c9520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:07.762225 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (343cf290-89da-4352-a06f-6f9444db2c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:07.763559 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Volume f560b40e-0e82-4a5d-9c45-a6fbb242d16d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f560b40e-0e82-4a5d-9c45-a6fbb242d16d', 'volume_size': 1}
Apr 16 21:25:07.763954 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] creating volume 'volume-f560b40e-0e82-4a5d-9c45-a6fbb242d16d' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:25:07.764637 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:25:07.803122 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:25:07.824346 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Flow 'volume_create_manager' (380b281e-655c-4668-a552-9216e88df9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:25:07.830800 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695d1a29-1ba2-45bd-a089-4af70cbcb11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:07.846973 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695d1a29-1ba2-45bd-a089-4af70cbcb11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-116700839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7a013d49-8155-471f-a5be-e984700792bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f360e4398cb4a08a17e660194b6320a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:25:07Z,use_quota=True,user_id='97979cbad1b94141ab1311fefffcde0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:07.853164 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d15f82-ca6b-42fa-a920-42e57f460141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:07.857427 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d15f82-ca6b-42fa-a920-42e57f460141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:07.862408 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2cb453-fceb-43ae-b15b-c3814166928d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:07.866576 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2cb453-fceb-43ae-b15b-c3814166928d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a013d49-8155-471f-a5be-e984700792bb', 'volume_name': 'volume-7a013d49-8155-471f-a5be-e984700792bb', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:07.871658 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e88eb9-b112-45c8-969a-fe2baf4f505b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:07.875749 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e88eb9-b112-45c8-969a-fe2baf4f505b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:07.881044 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d09e02-7d99-4e91-9a0f-fd3a6a45a73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:07.882127 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Volume 7a013d49-8155-471f-a5be-e984700792bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a013d49-8155-471f-a5be-e984700792bb', 'volume_size': 1}
Apr 16 21:25:07.882637 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] creating volume 'volume-7a013d49-8155-471f-a5be-e984700792bb' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:25:07.883305 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:25:08.384983 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-4a2aba76-78d7-4972-b34c-75bb1a7b2c14 req-e252fd55-46f6-4766-8607-e5e51de25490 tempest-AttachVolumeNegativeTest-1739448039 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:25:09.201967 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:25:09.202521 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:25:09.207288 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (343cf290-89da-4352-a06f-6f9444db2c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f560b40e-0e82-4a5d-9c45-a6fbb242d16d', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:09.218277 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d288ef9e-7f1a-4856-b4e2-eca828d76f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:09.246136 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-4a2aba76-78d7-4972-b34c-75bb1a7b2c14 req-e252fd55-46f6-4766-8607-e5e51de25490 tempest-AttachVolumeNegativeTest-1739448039 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.861s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:25:09.246935 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-4a2aba76-78d7-4972-b34c-75bb1a7b2c14 req-e252fd55-46f6-4766-8607-e5e51de25490 tempest-AttachVolumeNegativeTest-1739448039 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a89555a4-c1fe-4512-9779-1ac4ed29f291', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'a89555a4-c1fe-4512-9779-1ac4ed29f291', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:25:09.357362 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-4a2aba76-78d7-4972-b34c-75bb1a7b2c14 req-e252fd55-46f6-4766-8607-e5e51de25490 tempest-AttachVolumeNegativeTest-1739448039 None] Connection info returned from driver {'name': 'volumes/volume-a89555a4-c1fe-4512-9779-1ac4ed29f291', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a89555a4-c1fe-4512-9779-1ac4ed29f291', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f0c37437-0a77-44e0-acef-a395292d29b2'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:25:09.400746 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Volume volume-f560b40e-0e82-4a5d-9c45-a6fbb242d16d (f560b40e-0e82-4a5d-9c45-a6fbb242d16d): created successfully
Apr 16 21:25:09.411713 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d288ef9e-7f1a-4856-b4e2-eca828d76f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:09.439001 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Flow 'volume_create_manager' (c776ac83-af80-43c8-8450-40054023a413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:25:09.485771 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-4a2aba76-78d7-4972-b34c-75bb1a7b2c14 req-e252fd55-46f6-4766-8607-e5e51de25490 tempest-AttachVolumeNegativeTest-1739448039 None] attachment_update completed successfully.
Apr 16 21:25:09.498105 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:25:09.504972 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:25:09.504972 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d09e02-7d99-4e91-9a0f-fd3a6a45a73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a013d49-8155-471f-a5be-e984700792bb', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:09.507773 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16551e0c-b1c6-442e-b42c-a7a1812aa143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:09.555048 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-064a89cd-dfec-47fb-86fd-cb45a1aef74a tempest-ServersNegativeTestJSON-1640489356 None] Created volume successfully.
Apr 16 21:25:09.583980 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Volume volume-7a013d49-8155-471f-a5be-e984700792bb (7a013d49-8155-471f-a5be-e984700792bb): created successfully
Apr 16 21:25:09.595401 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16551e0c-b1c6-442e-b42c-a7a1812aa143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:09.605152 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Flow 'volume_create_manager' (380b281e-655c-4668-a552-9216e88df9d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:25:09.680059 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-94d4473a-5c41-41a6-a449-a9e27a6dab7c tempest-VolumesCloneTest-1802321178 None] Created volume successfully.
Apr 16 21:25:11.869159 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:25:11.949793 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Flow 'volume_create_manager' (55016316-1594-4a8e-8098-2cf10d957936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:25:11.980064 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9abbec-52c5-438b-a037-dd08c2c218a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:12.019183 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9abbec-52c5-438b-a037-dd08c2c218a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1275256821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=659b0bfd-8636-4c63-9e85-88f4a20c66e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f360e4398cb4a08a17e660194b6320a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:25:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=7a013d49-8155-471f-a5be-e984700792bb,status='creating',terminated_at=None,updated_at=2022-04-16T21:25:12Z,use_quota=True,user_id='97979cbad1b94141ab1311fefffcde0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:12.026744 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21cade5-ab87-4104-a81d-cf47b06ef4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:12.032065 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21cade5-ab87-4104-a81d-cf47b06ef4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:12.040572 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908531f7-07cf-4e04-8504-27e764da8289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:12.075370 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908531f7-07cf-4e04-8504-27e764da8289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '659b0bfd-8636-4c63-9e85-88f4a20c66e1', 'volume_name': 'volume-659b0bfd-8636-4c63-9e85-88f4a20c66e1', 'volume_size': 2, 'source_volid': '7a013d49-8155-471f-a5be-e984700792bb', 'source_volstatus': 'available'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:12.081145 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e25415-bb94-440a-8ced-6710e03f8db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:12.088699 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e25415-bb94-440a-8ced-6710e03f8db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:12.097622 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432ea5d3-1f37-4439-b6a9-44a5303782db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:12.100293 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Volume 659b0bfd-8636-4c63-9e85-88f4a20c66e1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-659b0bfd-8636-4c63-9e85-88f4a20c66e1', 'volume_size': 2, 'source_volid': '7a013d49-8155-471f-a5be-e984700792bb', 'source_volstatus': 'available'}
Apr 16 21:25:12.136907 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:25:12.609712 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] creating snapshot='volume-659b0bfd-8636-4c63-9e85-88f4a20c66e1.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:25:16.120067 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] cloning 'volume-7a013d49-8155-471f-a5be-e984700792bb@volume-659b0bfd-8636-4c63-9e85-88f4a20c66e1.clone_snap' to 'volume-659b0bfd-8636-4c63-9e85-88f4a20c66e1' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:25:18.458323 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Volume volume-7a013d49-8155-471f-a5be-e984700792bb is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:25:18.460741 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:25:18.461221 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:25:19.390308 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] resize volume 'volume-659b0bfd-8636-4c63-9e85-88f4a20c66e1' from 1 to 2 {{(pid=130674) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:742}}
Apr 16 21:25:19.391290 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:25:22.047350 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:25:22.054000 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432ea5d3-1f37-4439-b6a9-44a5303782db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-659b0bfd-8636-4c63-9e85-88f4a20c66e1', 'volume_size': 2, 'source_volid': '7a013d49-8155-471f-a5be-e984700792bb', 'source_volstatus': 'available'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:22.071694 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda59c58-c44e-4d38-b64e-48d130551144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:25:22.189320 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Volume volume-659b0bfd-8636-4c63-9e85-88f4a20c66e1 (659b0bfd-8636-4c63-9e85-88f4a20c66e1): created successfully
Apr 16 21:25:22.195210 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda59c58-c44e-4d38-b64e-48d130551144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:25:22.213558 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Flow 'volume_create_manager' (55016316-1594-4a8e-8098-2cf10d957936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:25:22.320327 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a78c0fbc-c10d-4366-9437-40ff92486dc0 tempest-VolumesCloneTest-1802321178 None] Created volume successfully.
Apr 16 21:25:22.663971 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:25:22.665415 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:25:22.737409 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:25:22.792751 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:25:23.723449 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5a339d41-1121-4c2e-bee6-82776d0c07cf tempest-VolumesCloneTest-1802321178 None] Lock "b'cinder-659b0bfd-8636-4c63-9e85-88f4a20c66e1-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:25:23.878891 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5a339d41-1121-4c2e-bee6-82776d0c07cf tempest-VolumesCloneTest-1802321178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:25:24.152540 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5a339d41-1121-4c2e-bee6-82776d0c07cf tempest-VolumesCloneTest-1802321178 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:25:24.622461 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5a339d41-1121-4c2e-bee6-82776d0c07cf tempest-VolumesCloneTest-1802321178 None] deleting rbd volume volume-659b0bfd-8636-4c63-9e85-88f4a20c66e1 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:25:33.690598 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5a339d41-1121-4c2e-bee6-82776d0c07cf tempest-VolumesCloneTest-1802321178 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:25:33.905731 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5a339d41-1121-4c2e-bee6-82776d0c07cf tempest-VolumesCloneTest-1802321178 None] Volume volume-7a013d49-8155-471f-a5be-e984700792bb is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:25:33.906430 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5a339d41-1121-4c2e-bee6-82776d0c07cf tempest-VolumesCloneTest-1802321178 None] deleting parent snapshot volume-659b0bfd-8636-4c63-9e85-88f4a20c66e1.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:25:37.381131 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-5a339d41-1121-4c2e-bee6-82776d0c07cf tempest-VolumesCloneTest-1802321178 None] Created reservations ['c874c104-54ad-48de-9151-cf655e0c1500', '97e269d1-7457-4a5b-8802-da10e296efa5', 'f1aed37d-ef28-4697-a40c-e533a6e8ae29', '1cabb0f1-fc69-4518-9edb-8e49df93dcbb'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:25:37.595306 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5a339d41-1121-4c2e-bee6-82776d0c07cf tempest-VolumesCloneTest-1802321178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:25:37.681293 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5a339d41-1121-4c2e-bee6-82776d0c07cf tempest-VolumesCloneTest-1802321178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:25:37.771479 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-5a339d41-1121-4c2e-bee6-82776d0c07cf tempest-VolumesCloneTest-1802321178 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:25:37.775875 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5a339d41-1121-4c2e-bee6-82776d0c07cf tempest-VolumesCloneTest-1802321178 None] Deleted volume successfully.
Apr 16 21:25:37.853367 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5a339d41-1121-4c2e-bee6-82776d0c07cf tempest-VolumesCloneTest-1802321178 None] Lock "b'cinder-659b0bfd-8636-4c63-9e85-88f4a20c66e1-delete_volume'" released by "delete_volume" :: held 14.131s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:25:38.018374 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c83c7b2a-3416-4bab-86af-d9bc70b8a61e tempest-VolumesCloneTest-1802321178 None] Lock "b'cinder-7a013d49-8155-471f-a5be-e984700792bb-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:25:38.143197 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c83c7b2a-3416-4bab-86af-d9bc70b8a61e tempest-VolumesCloneTest-1802321178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:25:38.500166 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c83c7b2a-3416-4bab-86af-d9bc70b8a61e tempest-VolumesCloneTest-1802321178 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:25:38.500920 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c83c7b2a-3416-4bab-86af-d9bc70b8a61e tempest-VolumesCloneTest-1802321178 None] Volume volume-7a013d49-8155-471f-a5be-e984700792bb is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:25:38.750288 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c83c7b2a-3416-4bab-86af-d9bc70b8a61e tempest-VolumesCloneTest-1802321178 None] deleting rbd volume volume-7a013d49-8155-471f-a5be-e984700792bb {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:25:46.521011 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-c83c7b2a-3416-4bab-86af-d9bc70b8a61e tempest-VolumesCloneTest-1802321178 None] Created reservations ['66e8982f-0b4d-4bc3-b791-12dfc3b936b5', '4cccb0d8-87cb-448e-9a29-0a0b96e9600a', 'a3755bf0-8e67-4f7c-9db2-984ea13c3160', 'c26431c0-5b81-44e4-9290-8168a5b9f6f1'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:25:46.752521 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c83c7b2a-3416-4bab-86af-d9bc70b8a61e tempest-VolumesCloneTest-1802321178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:25:46.777612 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c83c7b2a-3416-4bab-86af-d9bc70b8a61e tempest-VolumesCloneTest-1802321178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:25:46.811082 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-c83c7b2a-3416-4bab-86af-d9bc70b8a61e tempest-VolumesCloneTest-1802321178 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:25:46.819483 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c83c7b2a-3416-4bab-86af-d9bc70b8a61e tempest-VolumesCloneTest-1802321178 None] Deleted volume successfully.
Apr 16 21:25:46.932948 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c83c7b2a-3416-4bab-86af-d9bc70b8a61e tempest-VolumesCloneTest-1802321178 None] Lock "b'cinder-7a013d49-8155-471f-a5be-e984700792bb-delete_volume'" released by "delete_volume" :: held 8.915s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:25:47.841627 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-764c3c21-4c21-4d92-8dd4-8253503ebcfb tempest-VolumesCloneTest-1802321178 None] Lock "b'cinder-2a3a2a7a-b1da-43cf-a2e6-1bb5ee0cdc8c-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:25:47.990697 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-764c3c21-4c21-4d92-8dd4-8253503ebcfb tempest-VolumesCloneTest-1802321178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:25:48.289628 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-764c3c21-4c21-4d92-8dd4-8253503ebcfb tempest-VolumesCloneTest-1802321178 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:25:48.543984 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-764c3c21-4c21-4d92-8dd4-8253503ebcfb tempest-VolumesCloneTest-1802321178 None] deleting rbd volume volume-2a3a2a7a-b1da-43cf-a2e6-1bb5ee0cdc8c {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:25:55.955784 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-764c3c21-4c21-4d92-8dd4-8253503ebcfb tempest-VolumesCloneTest-1802321178 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:25:56.207588 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-764c3c21-4c21-4d92-8dd4-8253503ebcfb tempest-VolumesCloneTest-1802321178 None] deleting parent snapshot volume-2a3a2a7a-b1da-43cf-a2e6-1bb5ee0cdc8c.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:26:00.502995 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-764c3c21-4c21-4d92-8dd4-8253503ebcfb tempest-VolumesCloneTest-1802321178 None] Created reservations ['e765eb46-78da-493b-a6b0-69b38f46321d', '0e19d8a0-3c4b-4d63-a7fb-58db781f3e92', '262a8930-eeee-4b77-9d4c-c8f010b39f84', 'dc781a8b-eb6e-41cd-89a5-00caba9ca03d'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:26:00.725536 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-764c3c21-4c21-4d92-8dd4-8253503ebcfb tempest-VolumesCloneTest-1802321178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:00.844841 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-764c3c21-4c21-4d92-8dd4-8253503ebcfb tempest-VolumesCloneTest-1802321178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:00.921203 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-764c3c21-4c21-4d92-8dd4-8253503ebcfb tempest-VolumesCloneTest-1802321178 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:26:00.933806 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-764c3c21-4c21-4d92-8dd4-8253503ebcfb tempest-VolumesCloneTest-1802321178 None] Deleted volume successfully.
Apr 16 21:26:01.825154 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-764c3c21-4c21-4d92-8dd4-8253503ebcfb tempest-VolumesCloneTest-1802321178 None] Lock "b'cinder-2a3a2a7a-b1da-43cf-a2e6-1bb5ee0cdc8c-delete_volume'" released by "delete_volume" :: held 13.984s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:26:01.948847 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-fc73c04b-f164-4409-b16f-555ee38ce3a8 tempest-VolumesCloneTest-1802321178 None] Lock "b'cinder-c7950984-79c5-4c73-b6fd-6a85087a658e-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:26:02.243829 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fc73c04b-f164-4409-b16f-555ee38ce3a8 tempest-VolumesCloneTest-1802321178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:02.555145 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fc73c04b-f164-4409-b16f-555ee38ce3a8 tempest-VolumesCloneTest-1802321178 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:26:02.915150 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fc73c04b-f164-4409-b16f-555ee38ce3a8 tempest-VolumesCloneTest-1802321178 None] deleting rbd volume volume-c7950984-79c5-4c73-b6fd-6a85087a658e {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:26:11.406627 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fc73c04b-f164-4409-b16f-555ee38ce3a8 tempest-VolumesCloneTest-1802321178 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:26:11.713033 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fc73c04b-f164-4409-b16f-555ee38ce3a8 tempest-VolumesCloneTest-1802321178 None] deleting parent snapshot volume-c7950984-79c5-4c73-b6fd-6a85087a658e.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:26:15.326578 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-fc73c04b-f164-4409-b16f-555ee38ce3a8 tempest-VolumesCloneTest-1802321178 None] Created reservations ['070988da-62c2-4c14-9b3c-2714b6f57569', '914cc94c-98fd-47ba-9132-81b6bcdd3559', '7b2bb684-eb09-4589-a0e9-7ca069307f35', 'f542fc9a-0e80-4982-8f50-4d37646a5e27'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:26:15.629614 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fc73c04b-f164-4409-b16f-555ee38ce3a8 tempest-VolumesCloneTest-1802321178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:15.680929 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fc73c04b-f164-4409-b16f-555ee38ce3a8 tempest-VolumesCloneTest-1802321178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:15.718582 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-fc73c04b-f164-4409-b16f-555ee38ce3a8 tempest-VolumesCloneTest-1802321178 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:26:15.735098 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fc73c04b-f164-4409-b16f-555ee38ce3a8 tempest-VolumesCloneTest-1802321178 None] Deleted volume successfully.
Apr 16 21:26:15.844214 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-fc73c04b-f164-4409-b16f-555ee38ce3a8 tempest-VolumesCloneTest-1802321178 None] Lock "b'cinder-c7950984-79c5-4c73-b6fd-6a85087a658e-delete_volume'" released by "delete_volume" :: held 13.897s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:26:19.958036 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:26:19.980071 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Flow 'volume_create_manager' (46d5a3cc-98e8-4594-a7bf-a470904f6eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:26:19.986517 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e0d8a9-1b1d-4164-a83b-70fcc78a007f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:20.003682 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e0d8a9-1b1d-4164-a83b-70fcc78a007f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1556698098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=de5ab881-92ec-48e5-afbd-9a60f2758c41,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b52014206e274c3bb9d0a81b1cd38807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:26:20Z,use_quota=True,user_id='3341ea0baedf4d6285856d2ea0a88aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:20.009289 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a498ed4-02c9-4ff2-b382-b5193a6d80f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:20.013467 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a498ed4-02c9-4ff2-b382-b5193a6d80f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:20.019463 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b26767f-db93-41f6-bbbc-5fcb231e28c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:20.023692 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b26767f-db93-41f6-bbbc-5fcb231e28c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de5ab881-92ec-48e5-afbd-9a60f2758c41', 'volume_name': 'volume-de5ab881-92ec-48e5-afbd-9a60f2758c41', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:20.028916 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dab9b4-5455-419f-9d61-546b350d2b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:20.032886 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dab9b4-5455-419f-9d61-546b350d2b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:20.037834 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4c1432-c693-4b85-bd2f-5afb210c7efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:20.038904 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Volume de5ab881-92ec-48e5-afbd-9a60f2758c41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de5ab881-92ec-48e5-afbd-9a60f2758c41', 'volume_size': 1}
Apr 16 21:26:20.039496 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] creating volume 'volume-de5ab881-92ec-48e5-afbd-9a60f2758c41' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:26:20.040563 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:21.180287 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:26:21.180906 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:26:21.186430 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4c1432-c693-4b85-bd2f-5afb210c7efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de5ab881-92ec-48e5-afbd-9a60f2758c41', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:21.192452 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7036a64-3829-4163-88f6-1f11102f3acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:21.297389 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Volume volume-de5ab881-92ec-48e5-afbd-9a60f2758c41 (de5ab881-92ec-48e5-afbd-9a60f2758c41): created successfully
Apr 16 21:26:21.301840 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7036a64-3829-4163-88f6-1f11102f3acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:21.307955 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Flow 'volume_create_manager' (46d5a3cc-98e8-4594-a7bf-a470904f6eb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:26:21.434189 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0410894d-c5d0-4bd4-bd88-9e2a5cb9b664 tempest-VolumesGetTest-1619616332 None] Created volume successfully.
Apr 16 21:26:22.669916 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:26:22.670578 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:22.805924 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:22.881649 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:26:23.446040 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:26:23.477548 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Flow 'volume_create_manager' (d4329320-d96a-4c1c-a737-e0b6b78113b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:26:23.485247 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c32eb95-2854-4df9-9c56-0d589d42deb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:23.504463 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c32eb95-2854-4df9-9c56-0d589d42deb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:26:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-579780491',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=51ce9697-817b-446b-8515-e3ac84368fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b52014206e274c3bb9d0a81b1cd38807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:26:23Z,use_quota=True,user_id='3341ea0baedf4d6285856d2ea0a88aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:23.510736 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64901a7b-719b-4659-b428-b4783b656fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:23.516007 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64901a7b-719b-4659-b428-b4783b656fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:23.523621 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c697b1-1783-4db1-8097-2cea07edefd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:23.530022 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c697b1-1783-4db1-8097-2cea07edefd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51ce9697-817b-446b-8515-e3ac84368fa1', 'volume_name': 'volume-51ce9697-817b-446b-8515-e3ac84368fa1', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:23.538416 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744f6c32-43db-40e9-962f-80e896c0e612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:23.544652 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744f6c32-43db-40e9-962f-80e896c0e612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:23.551377 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e681f8c-90ec-403f-9d70-f2d88d7b225d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:23.552710 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Volume 51ce9697-817b-446b-8515-e3ac84368fa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51ce9697-817b-446b-8515-e3ac84368fa1', 'volume_size': 1}
Apr 16 21:26:23.553158 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] creating volume 'volume-51ce9697-817b-446b-8515-e3ac84368fa1' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:26:23.553898 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:24.510268 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:26:24.511009 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:26:24.517326 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e681f8c-90ec-403f-9d70-f2d88d7b225d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51ce9697-817b-446b-8515-e3ac84368fa1', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:24.542533 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba7207e-ceea-4d85-991b-9f1b9203b3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:24.629430 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Volume volume-51ce9697-817b-446b-8515-e3ac84368fa1 (51ce9697-817b-446b-8515-e3ac84368fa1): created successfully
Apr 16 21:26:24.635965 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba7207e-ceea-4d85-991b-9f1b9203b3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:24.645672 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Flow 'volume_create_manager' (d4329320-d96a-4c1c-a737-e0b6b78113b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:26:24.775178 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fce830ea-a997-49af-94a4-676e39c4a002 tempest-VolumesGetTest-1619616332 None] Created volume successfully.
Apr 16 21:26:25.654100 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-c2acd2ec-85c9-422c-8255-6d04c442eb25 req-69d75286-c7cb-4399-a8a1-86683df72a7c tempest-AttachVolumeNegativeTest-1739448039 None] Terminate volume connection completed successfully.
Apr 16 21:26:25.655510 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-c2acd2ec-85c9-422c-8255-6d04c442eb25 req-69d75286-c7cb-4399-a8a1-86683df72a7c tempest-AttachVolumeNegativeTest-1739448039 None] Deleting attachment f0c37437-0a77-44e0-acef-a395292d29b2. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:26:25.660539 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b9ed1fc8-7fd6-4420-9599-b810e7418484 tempest-VolumesGetTest-1619616332 None] Lock "b'cinder-51ce9697-817b-446b-8515-e3ac84368fa1-delete_volume'" acquired by "delete_volume" :: waited 0.041s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:26:25.789717 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9ed1fc8-7fd6-4420-9599-b810e7418484 tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:26.103194 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9ed1fc8-7fd6-4420-9599-b810e7418484 tempest-VolumesGetTest-1619616332 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:26:26.103635 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9ed1fc8-7fd6-4420-9599-b810e7418484 tempest-VolumesGetTest-1619616332 None] Volume volume-51ce9697-817b-446b-8515-e3ac84368fa1 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:26:26.404034 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9ed1fc8-7fd6-4420-9599-b810e7418484 tempest-VolumesGetTest-1619616332 None] deleting rbd volume volume-51ce9697-817b-446b-8515-e3ac84368fa1 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:26:36.046098 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-b9ed1fc8-7fd6-4420-9599-b810e7418484 tempest-VolumesGetTest-1619616332 None] Created reservations ['1d5a3e02-39ea-4197-a55f-ff77d9c10c31', '2b5fc5d1-b7fa-4f98-8a37-649d3a0e56ca', 'ebd80120-1f47-467d-9f19-dd4aff49e5b1', 'e406a25e-19a3-4478-b151-7849d73d7711'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:26:36.355094 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9ed1fc8-7fd6-4420-9599-b810e7418484 tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:36.377213 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9ed1fc8-7fd6-4420-9599-b810e7418484 tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:36.399695 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-b9ed1fc8-7fd6-4420-9599-b810e7418484 tempest-VolumesGetTest-1619616332 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:26:36.407745 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b9ed1fc8-7fd6-4420-9599-b810e7418484 tempest-VolumesGetTest-1619616332 None] Deleted volume successfully.
Apr 16 21:26:36.502516 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b9ed1fc8-7fd6-4420-9599-b810e7418484 tempest-VolumesGetTest-1619616332 None] Lock "b'cinder-51ce9697-817b-446b-8515-e3ac84368fa1-delete_volume'" released by "delete_volume" :: held 10.844s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:26:36.586448 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-30ce7e3c-8dac-40a6-b126-6bafb9d392ad tempest-VolumesGetTest-1619616332 None] Lock "b'cinder-de5ab881-92ec-48e5-afbd-9a60f2758c41-delete_volume'" acquired by "delete_volume" :: waited 0.053s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:26:36.702117 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-30ce7e3c-8dac-40a6-b126-6bafb9d392ad tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:37.517480 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-30ce7e3c-8dac-40a6-b126-6bafb9d392ad tempest-VolumesGetTest-1619616332 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:26:37.519011 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-30ce7e3c-8dac-40a6-b126-6bafb9d392ad tempest-VolumesGetTest-1619616332 None] Volume volume-de5ab881-92ec-48e5-afbd-9a60f2758c41 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:26:37.816294 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-30ce7e3c-8dac-40a6-b126-6bafb9d392ad tempest-VolumesGetTest-1619616332 None] deleting rbd volume volume-de5ab881-92ec-48e5-afbd-9a60f2758c41 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:26:46.003097 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-30ce7e3c-8dac-40a6-b126-6bafb9d392ad tempest-VolumesGetTest-1619616332 None] Created reservations ['fe38ab8a-229a-4395-88b8-ef4e39247f4a', '318a8483-b4e0-415c-8f58-165cb2801cad', 'fdfc3fe0-1b86-46d3-9de0-f3ab4e4bd8b1', '7077cf50-9fe2-4a61-8ba2-2dd94ab36540'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:26:46.406611 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-30ce7e3c-8dac-40a6-b126-6bafb9d392ad tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:46.463838 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-30ce7e3c-8dac-40a6-b126-6bafb9d392ad tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:46.555522 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-30ce7e3c-8dac-40a6-b126-6bafb9d392ad tempest-VolumesGetTest-1619616332 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:26:46.559847 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-30ce7e3c-8dac-40a6-b126-6bafb9d392ad tempest-VolumesGetTest-1619616332 None] Deleted volume successfully.
Apr 16 21:26:46.692304 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-30ce7e3c-8dac-40a6-b126-6bafb9d392ad tempest-VolumesGetTest-1619616332 None] Lock "b'cinder-de5ab881-92ec-48e5-afbd-9a60f2758c41-delete_volume'" released by "delete_volume" :: held 10.106s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:26:47.521308 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:26:47.559733 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Flow 'volume_create_manager' (bc7ef409-5551-47a3-8e28-2e4dbd3757dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:26:47.568142 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee033f7e-a34b-4c58-af56-98167c5bf92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:47.592223 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee033f7e-a34b-4c58-af56-98167c5bf92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1974205113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4104530d-c326-425d-9d32-330b7ab763f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b52014206e274c3bb9d0a81b1cd38807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:26:47Z,use_quota=True,user_id='3341ea0baedf4d6285856d2ea0a88aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:47.599731 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a86519-3888-44d0-a312-9179e21f2346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:47.604328 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a86519-3888-44d0-a312-9179e21f2346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:47.612668 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8048b48-d2f8-431f-af05-46c6aeb5ccb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:47.615864 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8048b48-d2f8-431f-af05-46c6aeb5ccb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4104530d-c326-425d-9d32-330b7ab763f3', 'volume_name': 'volume-4104530d-c326-425d-9d32-330b7ab763f3', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:47.621949 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768f3506-9be9-41d9-9175-1b232c398c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:47.626614 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768f3506-9be9-41d9-9175-1b232c398c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:47.632766 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52f20a6-ff25-407b-a665-fe447f5baa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:47.634817 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Volume 4104530d-c326-425d-9d32-330b7ab763f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4104530d-c326-425d-9d32-330b7ab763f3', 'volume_size': 1}
Apr 16 21:26:47.635391 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] creating volume 'volume-4104530d-c326-425d-9d32-330b7ab763f3' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:26:47.636487 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:48.819267 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:26:48.820518 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:26:48.825160 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52f20a6-ff25-407b-a665-fe447f5baa81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4104530d-c326-425d-9d32-330b7ab763f3', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:48.830793 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01f7e83-4262-4f3f-a809-067baef2c38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:48.913678 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Volume volume-4104530d-c326-425d-9d32-330b7ab763f3 (4104530d-c326-425d-9d32-330b7ab763f3): created successfully
Apr 16 21:26:48.921767 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01f7e83-4262-4f3f-a809-067baef2c38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:48.929352 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Flow 'volume_create_manager' (bc7ef409-5551-47a3-8e28-2e4dbd3757dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:26:48.994906 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6f0015df-dee0-4a31-b818-b4def1329697 tempest-VolumesGetTest-1619616332 None] Created volume successfully.
Apr 16 21:26:50.687726 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:26:50.729995 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Flow 'volume_create_manager' (31de4aa1-b26e-45ea-bb6b-250f21150f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:26:50.738532 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb74024-f84a-4b8e-9596-3907606f45f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:50.765502 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb74024-f84a-4b8e-9596-3907606f45f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-190146121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=90eeadef-f431-4cba-b84c-cb5206e21e2a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b52014206e274c3bb9d0a81b1cd38807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=4104530d-c326-425d-9d32-330b7ab763f3,status='creating',terminated_at=None,updated_at=2022-04-16T21:26:50Z,use_quota=True,user_id='3341ea0baedf4d6285856d2ea0a88aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:50.766041 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc031f8-8096-4b5a-8b7a-1033c46f74c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:50.769302 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc031f8-8096-4b5a-8b7a-1033c46f74c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:50.774623 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd62a6a6-f3a2-4a86-aef3-af4c19c9753d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:50.791014 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd62a6a6-f3a2-4a86-aef3-af4c19c9753d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '90eeadef-f431-4cba-b84c-cb5206e21e2a', 'volume_name': 'volume-90eeadef-f431-4cba-b84c-cb5206e21e2a', 'volume_size': 1, 'source_volid': '4104530d-c326-425d-9d32-330b7ab763f3', 'source_volstatus': 'available'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:50.796416 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1e800c-a693-4866-bb4f-5942d009e555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:50.801046 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1e800c-a693-4866-bb4f-5942d009e555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:50.806079 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca728dc9-a298-4d64-8bd3-81da4da49878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:50.807565 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Volume 90eeadef-f431-4cba-b84c-cb5206e21e2a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-90eeadef-f431-4cba-b84c-cb5206e21e2a', 'volume_size': 1, 'source_volid': '4104530d-c326-425d-9d32-330b7ab763f3', 'source_volstatus': 'available'}
Apr 16 21:26:50.820814 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:51.126118 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] creating snapshot='volume-90eeadef-f431-4cba-b84c-cb5206e21e2a.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:26:54.403990 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] cloning 'volume-4104530d-c326-425d-9d32-330b7ab763f3@volume-90eeadef-f431-4cba-b84c-cb5206e21e2a.clone_snap' to 'volume-90eeadef-f431-4cba-b84c-cb5206e21e2a' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:26:54.504821 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:26:54.524722 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Flow 'volume_create_manager' (fdd545cd-a8ac-462d-8099-349def0a135a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:26:54.532943 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0c2306-a456-4552-9398-3fbd1f625180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:54.550474 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0c2306-a456-4552-9398-3fbd1f625180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-811103986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f223a2a2-765c-49ae-bee0-ac5274eb99a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1aa0603f7146e5914a959bd9c19800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:26:54Z,use_quota=True,user_id='12d7aec9a7ff442fad639e44ffd65d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:54.556599 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385698e7-0ce4-46d7-93d1-63a84accdf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:54.561945 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385698e7-0ce4-46d7-93d1-63a84accdf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:54.568003 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ce71a4-a46f-49ed-b708-aaa734795f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:54.573159 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ce71a4-a46f-49ed-b708-aaa734795f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f223a2a2-765c-49ae-bee0-ac5274eb99a7', 'volume_name': 'volume-f223a2a2-765c-49ae-bee0-ac5274eb99a7', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:54.578875 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d69fc3-702c-43dc-aaa1-6704d8ca712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:54.591755 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d69fc3-702c-43dc-aaa1-6704d8ca712a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:54.603536 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e20a39-4ccd-4a89-aa9f-a7f2131dd368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:54.603536 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Volume f223a2a2-765c-49ae-bee0-ac5274eb99a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f223a2a2-765c-49ae-bee0-ac5274eb99a7', 'volume_size': 1}
Apr 16 21:26:54.603536 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] creating volume 'volume-f223a2a2-765c-49ae-bee0-ac5274eb99a7' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:26:54.603536 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:55.271593 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-81266be2-d575-468a-a0cc-79650e728746 tempest-ServersNegativeTestJSON-1640489356 None] Lock "b'cinder-f560b40e-0e82-4a5d-9c45-a6fbb242d16d-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:26:55.370943 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-81266be2-d575-468a-a0cc-79650e728746 tempest-ServersNegativeTestJSON-1640489356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:55.677807 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-81266be2-d575-468a-a0cc-79650e728746 tempest-ServersNegativeTestJSON-1640489356 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:26:55.678915 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-81266be2-d575-468a-a0cc-79650e728746 tempest-ServersNegativeTestJSON-1640489356 None] Volume volume-f560b40e-0e82-4a5d-9c45-a6fbb242d16d is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:26:56.000484 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-81266be2-d575-468a-a0cc-79650e728746 tempest-ServersNegativeTestJSON-1640489356 None] deleting rbd volume volume-f560b40e-0e82-4a5d-9c45-a6fbb242d16d {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:26:56.005847 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:26:56.006230 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:26:56.010056 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e20a39-4ccd-4a89-aa9f-a7f2131dd368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f223a2a2-765c-49ae-bee0-ac5274eb99a7', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:56.015211 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5f82c2-5da2-4def-a15a-a34191d852d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:56.134214 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Volume volume-f223a2a2-765c-49ae-bee0-ac5274eb99a7 (f223a2a2-765c-49ae-bee0-ac5274eb99a7): created successfully
Apr 16 21:26:56.138261 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5f82c2-5da2-4def-a15a-a34191d852d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:56.144389 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Flow 'volume_create_manager' (fdd545cd-a8ac-462d-8099-349def0a135a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:26:56.266664 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7a62d5db-b976-4a02-a8cd-417478f15fa5 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Created volume successfully.
Apr 16 21:26:56.931037 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Volume volume-4104530d-c326-425d-9d32-330b7ab763f3 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:26:56.933346 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:26:56.933732 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:26:57.612847 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:26:57.616901 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca728dc9-a298-4d64-8bd3-81da4da49878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90eeadef-f431-4cba-b84c-cb5206e21e2a', 'volume_size': 1, 'source_volid': '4104530d-c326-425d-9d32-330b7ab763f3', 'source_volstatus': 'available'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:57.621608 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4621c51-6233-43ab-9bc5-fe259b15365e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:57.726138 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Volume volume-90eeadef-f431-4cba-b84c-cb5206e21e2a (90eeadef-f431-4cba-b84c-cb5206e21e2a): created successfully
Apr 16 21:26:57.730910 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4621c51-6233-43ab-9bc5-fe259b15365e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:57.737332 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Flow 'volume_create_manager' (31de4aa1-b26e-45ea-bb6b-250f21150f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:26:58.197502 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-67dec77e-c810-4bcd-b522-4f9928dfd2a8 tempest-VolumesGetTest-1619616332 None] Created volume successfully.
Apr 16 21:26:58.220406 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-2c70e9d9-4ee4-4550-b9e0-80143b9e7490 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Lock "b'cinder-f223a2a2-765c-49ae-bee0-ac5274eb99a7-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:26:58.452542 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2c70e9d9-4ee4-4550-b9e0-80143b9e7490 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:26:59.060163 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2c70e9d9-4ee4-4550-b9e0-80143b9e7490 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:26:59.060622 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2c70e9d9-4ee4-4550-b9e0-80143b9e7490 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Volume volume-f223a2a2-765c-49ae-bee0-ac5274eb99a7 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:26:59.450830 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2c70e9d9-4ee4-4550-b9e0-80143b9e7490 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] deleting rbd volume volume-f223a2a2-765c-49ae-bee0-ac5274eb99a7 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:26:59.659907 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:26:59.680285 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Flow 'volume_create_manager' (47faa840-29e5-4ca2-87b8-868d7c1c31e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:26:59.689775 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472d2ac2-f4cf-4044-a8cd-7303c9963034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:59.705308 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472d2ac2-f4cf-4044-a8cd-7303c9963034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:26:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1341293811',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f3854b46-9bac-4f30-95f2-74bbbc34623b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b52014206e274c3bb9d0a81b1cd38807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:26:59Z,use_quota=True,user_id='3341ea0baedf4d6285856d2ea0a88aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:59.710821 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265c4287-e3df-4b58-9955-d01cd2d32be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:59.715187 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265c4287-e3df-4b58-9955-d01cd2d32be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:59.720508 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbae62ce-5052-4928-888c-cba14e2721b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:59.725225 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbae62ce-5052-4928-888c-cba14e2721b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3854b46-9bac-4f30-95f2-74bbbc34623b', 'volume_name': 'volume-f3854b46-9bac-4f30-95f2-74bbbc34623b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:59.730222 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceeafbb9-dc15-49ed-bac4-9515d5199881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:59.734188 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceeafbb9-dc15-49ed-bac4-9515d5199881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:26:59.739609 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1845cf5-80d9-49a8-ab53-6b26d630f07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:26:59.740738 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Volume f3854b46-9bac-4f30-95f2-74bbbc34623b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3854b46-9bac-4f30-95f2-74bbbc34623b', 'volume_size': 1}
Apr 16 21:26:59.741132 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] creating volume 'volume-f3854b46-9bac-4f30-95f2-74bbbc34623b' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:26:59.741858 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:00.836441 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:27:00.837029 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:27:00.841020 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1845cf5-80d9-49a8-ab53-6b26d630f07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3854b46-9bac-4f30-95f2-74bbbc34623b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:00.845898 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00c20ea-e373-494f-956a-cf66e1ffe26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:00.925880 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Volume volume-f3854b46-9bac-4f30-95f2-74bbbc34623b (f3854b46-9bac-4f30-95f2-74bbbc34623b): created successfully
Apr 16 21:27:00.929764 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00c20ea-e373-494f-956a-cf66e1ffe26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:00.935988 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Flow 'volume_create_manager' (47faa840-29e5-4ca2-87b8-868d7c1c31e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:27:01.011629 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b2396a91-da9f-4cb3-941b-b546eaee0634 tempest-VolumesGetTest-1619616332 None] Created volume successfully.
Apr 16 21:27:01.993740 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f41c43b2-aeff-443b-835b-3be77e23428f tempest-VolumesGetTest-1619616332 None] Lock "b'cinder-f3854b46-9bac-4f30-95f2-74bbbc34623b-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:27:02.138888 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f41c43b2-aeff-443b-835b-3be77e23428f tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:02.337742 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f41c43b2-aeff-443b-835b-3be77e23428f tempest-VolumesGetTest-1619616332 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:27:02.339569 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f41c43b2-aeff-443b-835b-3be77e23428f tempest-VolumesGetTest-1619616332 None] Volume volume-f3854b46-9bac-4f30-95f2-74bbbc34623b is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:27:02.598059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f41c43b2-aeff-443b-835b-3be77e23428f tempest-VolumesGetTest-1619616332 None] deleting rbd volume volume-f3854b46-9bac-4f30-95f2-74bbbc34623b {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:27:05.220444 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-81266be2-d575-468a-a0cc-79650e728746 tempest-ServersNegativeTestJSON-1640489356 None] Created reservations ['e07bceb9-9ad5-46a0-bdc3-91bbce58bfae', 'f7dee7cc-0fae-4a3d-924a-15c167393896', 'c007af5d-dad1-41dc-a879-620a32a07077', '1ea69e2d-1b6b-465e-b64a-1d4514ebaba3'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:27:05.434939 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-81266be2-d575-468a-a0cc-79650e728746 tempest-ServersNegativeTestJSON-1640489356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:05.456519 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-81266be2-d575-468a-a0cc-79650e728746 tempest-ServersNegativeTestJSON-1640489356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:05.477964 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-81266be2-d575-468a-a0cc-79650e728746 tempest-ServersNegativeTestJSON-1640489356 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:27:05.482079 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-81266be2-d575-468a-a0cc-79650e728746 tempest-ServersNegativeTestJSON-1640489356 None] Deleted volume successfully.
Apr 16 21:27:05.570526 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-81266be2-d575-468a-a0cc-79650e728746 tempest-ServersNegativeTestJSON-1640489356 None] Lock "b'cinder-f560b40e-0e82-4a5d-9c45-a6fbb242d16d-delete_volume'" released by "delete_volume" :: held 10.300s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:27:06.209969 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-2e09d582-aa8a-4d36-b8e1-c915961cf03a tempest-ServersNegativeTestJSON-1640489356 None] Lock "b'cinder-302aed6d-4327-400f-b1cc-7330052c22f1-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:27:06.343338 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2e09d582-aa8a-4d36-b8e1-c915961cf03a tempest-ServersNegativeTestJSON-1640489356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:06.694225 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2e09d582-aa8a-4d36-b8e1-c915961cf03a tempest-ServersNegativeTestJSON-1640489356 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:27:06.694657 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2e09d582-aa8a-4d36-b8e1-c915961cf03a tempest-ServersNegativeTestJSON-1640489356 None] Volume volume-302aed6d-4327-400f-b1cc-7330052c22f1 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:27:07.006814 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2e09d582-aa8a-4d36-b8e1-c915961cf03a tempest-ServersNegativeTestJSON-1640489356 None] deleting rbd volume volume-302aed6d-4327-400f-b1cc-7330052c22f1 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:27:08.233716 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-2c70e9d9-4ee4-4550-b9e0-80143b9e7490 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Created reservations ['e261cc2a-6762-4508-952f-c5b1f2fa51d2', '81fbc7f4-0b97-4e07-a623-2a0af053fc9b', '292dd337-b77e-489b-b7c9-53b5133f36bc', '1b171578-2f5e-4c88-a292-5b0bc17270bc'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:27:08.598263 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2c70e9d9-4ee4-4550-b9e0-80143b9e7490 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:08.636713 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2c70e9d9-4ee4-4550-b9e0-80143b9e7490 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:08.816448 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-2c70e9d9-4ee4-4550-b9e0-80143b9e7490 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:27:08.821052 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2c70e9d9-4ee4-4550-b9e0-80143b9e7490 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Deleted volume successfully.
Apr 16 21:27:08.951742 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-2c70e9d9-4ee4-4550-b9e0-80143b9e7490 tempest-VolumeQuotasNegativeTestJSON-1778976915 None] Lock "b'cinder-f223a2a2-765c-49ae-bee0-ac5274eb99a7-delete_volume'" released by "delete_volume" :: held 10.731s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:27:10.349740 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-55cec597-c03d-4185-bc0c-8cf70c27b6cb tempest-DeleteServersTestJSON-2058819142 None] Lock "b'cinder-dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:27:10.496356 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-55cec597-c03d-4185-bc0c-8cf70c27b6cb tempest-DeleteServersTestJSON-2058819142 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:10.846726 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-55cec597-c03d-4185-bc0c-8cf70c27b6cb tempest-DeleteServersTestJSON-2058819142 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:27:10.847161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-55cec597-c03d-4185-bc0c-8cf70c27b6cb tempest-DeleteServersTestJSON-2058819142 None] Volume volume-dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:27:11.086753 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-55cec597-c03d-4185-bc0c-8cf70c27b6cb tempest-DeleteServersTestJSON-2058819142 None] deleting rbd volume volume-dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:27:11.517624 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-f41c43b2-aeff-443b-835b-3be77e23428f tempest-VolumesGetTest-1619616332 None] Created reservations ['7df030e6-2bde-4836-8710-4d288e489ba4', 'c0002e5e-948f-4745-9f07-1a84572142c7', '8ed12b42-91a1-495a-97ee-f776690a65bc', '05949895-843f-41ab-8528-35d5954b03b1'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:27:11.855519 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f41c43b2-aeff-443b-835b-3be77e23428f tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:11.899578 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f41c43b2-aeff-443b-835b-3be77e23428f tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:11.948198 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-f41c43b2-aeff-443b-835b-3be77e23428f tempest-VolumesGetTest-1619616332 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:27:11.953304 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f41c43b2-aeff-443b-835b-3be77e23428f tempest-VolumesGetTest-1619616332 None] Deleted volume successfully.
Apr 16 21:27:12.045653 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f41c43b2-aeff-443b-835b-3be77e23428f tempest-VolumesGetTest-1619616332 None] Lock "b'cinder-f3854b46-9bac-4f30-95f2-74bbbc34623b-delete_volume'" released by "delete_volume" :: held 10.052s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:27:12.837801 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-4e935f27-4237-4523-8c6f-a8ab5344d357 tempest-VolumesGetTest-1619616332 None] Lock "b'cinder-90eeadef-f431-4cba-b84c-cb5206e21e2a-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:27:12.965463 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4e935f27-4237-4523-8c6f-a8ab5344d357 tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:13.280081 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4e935f27-4237-4523-8c6f-a8ab5344d357 tempest-VolumesGetTest-1619616332 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:27:13.593182 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4e935f27-4237-4523-8c6f-a8ab5344d357 tempest-VolumesGetTest-1619616332 None] deleting rbd volume volume-90eeadef-f431-4cba-b84c-cb5206e21e2a {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:27:15.216057 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:27:15.235691 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Flow 'volume_create_manager' (c28fc1be-7a9e-4b2c-bc0d-f853b2c65432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:27:15.242262 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57d67cf-ad5a-417b-80d9-4718f6fc26b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:15.258488 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57d67cf-ad5a-417b-80d9-4718f6fc26b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-986145639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8a31c3b5-5649-44bf-8b54-3af9e8bcbc48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b6e01c6acc41eeb83106b2e9830fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:27:15Z,use_quota=True,user_id='d59fae3205f9483d850750bfe5a304b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:15.264077 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7df6126-5eab-4548-ad9f-bebfdf44605b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:15.269088 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7df6126-5eab-4548-ad9f-bebfdf44605b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:15.274903 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6de9a8-95ea-4ce1-9813-b21d8b0422d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:15.279736 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6de9a8-95ea-4ce1-9813-b21d8b0422d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a31c3b5-5649-44bf-8b54-3af9e8bcbc48', 'volume_name': 'volume-8a31c3b5-5649-44bf-8b54-3af9e8bcbc48', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:15.285663 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25819c99-4e2d-41d2-9a78-13e7f1917e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:15.290361 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25819c99-4e2d-41d2-9a78-13e7f1917e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:15.295135 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3042bc49-f487-433c-b152-053115ee0361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:15.296232 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Volume 8a31c3b5-5649-44bf-8b54-3af9e8bcbc48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a31c3b5-5649-44bf-8b54-3af9e8bcbc48', 'volume_size': 1}
Apr 16 21:27:15.296626 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] creating volume 'volume-8a31c3b5-5649-44bf-8b54-3af9e8bcbc48' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:27:15.297410 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:15.574735 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-2e09d582-aa8a-4d36-b8e1-c915961cf03a tempest-ServersNegativeTestJSON-1640489356 None] Created reservations ['4b0284b2-6084-4a67-b032-820e48a64c19', 'a0351e99-bd1e-4c67-b69b-d5c22e26182b', '7f57b50d-c95c-4fe2-8f9a-731f1a8ec549', '4c71abc9-290a-4d81-a8ea-efcee897010d'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:27:15.791905 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2e09d582-aa8a-4d36-b8e1-c915961cf03a tempest-ServersNegativeTestJSON-1640489356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:15.839259 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2e09d582-aa8a-4d36-b8e1-c915961cf03a tempest-ServersNegativeTestJSON-1640489356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:15.893025 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-2e09d582-aa8a-4d36-b8e1-c915961cf03a tempest-ServersNegativeTestJSON-1640489356 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:27:15.897186 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2e09d582-aa8a-4d36-b8e1-c915961cf03a tempest-ServersNegativeTestJSON-1640489356 None] Deleted volume successfully.
Apr 16 21:27:15.961781 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-2e09d582-aa8a-4d36-b8e1-c915961cf03a tempest-ServersNegativeTestJSON-1640489356 None] Lock "b'cinder-302aed6d-4327-400f-b1cc-7330052c22f1-delete_volume'" released by "delete_volume" :: held 9.752s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:27:16.226500 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:27:16.227165 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:27:16.230823 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3042bc49-f487-433c-b152-053115ee0361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a31c3b5-5649-44bf-8b54-3af9e8bcbc48', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:16.235732 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955648f6-3ea8-44c0-a27b-348643240174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:16.300623 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Volume volume-8a31c3b5-5649-44bf-8b54-3af9e8bcbc48 (8a31c3b5-5649-44bf-8b54-3af9e8bcbc48): created successfully
Apr 16 21:27:16.304468 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955648f6-3ea8-44c0-a27b-348643240174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:16.310529 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Flow 'volume_create_manager' (c28fc1be-7a9e-4b2c-bc0d-f853b2c65432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:27:16.377249 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cf5fa928-b8d6-4419-8b69-8d99fa0bdffb tempest-VolumesBackupsAdminTest-1425647500 None] Created volume successfully.
Apr 16 21:27:18.124889 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-64df4430-da36-4739-b705-952b193b9734 tempest-VolumesBackupsAdminTest-1425647500 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-16T21:27:17Z,data_timestamp=2022-04-16T21:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1156029311',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=f1ba7d55-fe5a-4b81-ba86-3d6e7504fb5b,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='b2b6e01c6acc41eeb83106b2e9830fe4',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='d59fae3205f9483d850750bfe5a304b7',volume_id=8a31c3b5-5649-44bf-8b54-3af9e8bcbc48)
Apr 16 21:27:18.131708 ncdv-master-1 cinder-volume[130674]: INFO cinder.rpc [None req-64df4430-da36-4739-b705-952b193b9734 tempest-VolumesBackupsAdminTest-1425647500 None] Automatically selected cinder-backup objects version 1.39 as minimum service version.
Apr 16 21:27:18.137081 ncdv-master-1 cinder-volume[130674]: INFO cinder.rpc [None req-64df4430-da36-4739-b705-952b193b9734 tempest-VolumesBackupsAdminTest-1425647500 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version.
Apr 16 21:27:18.138853 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.backup.rpcapi [None req-64df4430-da36-4739-b705-952b193b9734 tempest-VolumesBackupsAdminTest-1425647500 None] continue_backup in rpcapi backup_id f1ba7d55-fe5a-4b81-ba86-3d6e7504fb5b {{(pid=130674) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Apr 16 21:27:19.056564 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-55cec597-c03d-4185-bc0c-8cf70c27b6cb tempest-DeleteServersTestJSON-2058819142 None] Created reservations ['147ed885-669f-48ae-a022-af2dd79fd00e', '53faae45-8c03-4596-b6d6-561436d672c1', '63dc3c8c-fa3b-4274-a12c-df7473d1f6d3', '2dc5ab3b-a0df-4f31-a789-10b54f3d026d'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:27:19.226258 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-55cec597-c03d-4185-bc0c-8cf70c27b6cb tempest-DeleteServersTestJSON-2058819142 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:19.265154 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-55cec597-c03d-4185-bc0c-8cf70c27b6cb tempest-DeleteServersTestJSON-2058819142 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:19.305607 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-55cec597-c03d-4185-bc0c-8cf70c27b6cb tempest-DeleteServersTestJSON-2058819142 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:27:19.311354 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-55cec597-c03d-4185-bc0c-8cf70c27b6cb tempest-DeleteServersTestJSON-2058819142 None] Deleted volume successfully.
Apr 16 21:27:19.421310 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-55cec597-c03d-4185-bc0c-8cf70c27b6cb tempest-DeleteServersTestJSON-2058819142 None] Lock "b'cinder-dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4-delete_volume'" released by "delete_volume" :: held 9.072s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:27:21.487855 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4e935f27-4237-4523-8c6f-a8ab5344d357 tempest-VolumesGetTest-1619616332 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:27:21.729586 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4e935f27-4237-4523-8c6f-a8ab5344d357 tempest-VolumesGetTest-1619616332 None] Volume volume-4104530d-c326-425d-9d32-330b7ab763f3 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:27:21.730285 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4e935f27-4237-4523-8c6f-a8ab5344d357 tempest-VolumesGetTest-1619616332 None] deleting parent snapshot volume-90eeadef-f431-4cba-b84c-cb5206e21e2a.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:27:25.476817 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:27:25.476817 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:25.506453 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:25.553253 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:27:25.559942 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-64df4430-da36-4739-b705-952b193b9734 tempest-VolumesBackupsAdminTest-1425647500 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:27:25.752890 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-4e935f27-4237-4523-8c6f-a8ab5344d357 tempest-VolumesGetTest-1619616332 None] Created reservations ['a650b74b-3d3e-46e4-9845-2f2aded3992d', 'f4b90a81-fa66-4696-873b-33e9476af919', 'e3f85b3d-da43-4a56-8695-232c012b8db1', '93b2576c-d895-4438-96d4-38d2b4aba7e1'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:27:25.961832 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4e935f27-4237-4523-8c6f-a8ab5344d357 tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:26.026765 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4e935f27-4237-4523-8c6f-a8ab5344d357 tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:26.074242 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-4e935f27-4237-4523-8c6f-a8ab5344d357 tempest-VolumesGetTest-1619616332 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:27:26.078985 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4e935f27-4237-4523-8c6f-a8ab5344d357 tempest-VolumesGetTest-1619616332 None] Deleted volume successfully.
Apr 16 21:27:26.161106 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-4e935f27-4237-4523-8c6f-a8ab5344d357 tempest-VolumesGetTest-1619616332 None] Lock "b'cinder-90eeadef-f431-4cba-b84c-cb5206e21e2a-delete_volume'" released by "delete_volume" :: held 13.323s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:27:26.375336 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-64df4430-da36-4739-b705-952b193b9734 tempest-VolumesBackupsAdminTest-1425647500 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.817s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:27:26.375987 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-64df4430-da36-4739-b705-952b193b9734 tempest-VolumesBackupsAdminTest-1425647500 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8a31c3b5-5649-44bf-8b54-3af9e8bcbc48', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '8a31c3b5-5649-44bf-8b54-3af9e8bcbc48', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:27:26.388667 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-64df4430-da36-4739-b705-952b193b9734 tempest-VolumesBackupsAdminTest-1425647500 None] Initialize volume connection completed successfully.
Apr 16 21:27:27.955905 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:27:27.991749 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Flow 'volume_create_manager' (08034c8f-6d86-4e9b-a89f-e9ac1c49f2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:27:27.998517 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3d1af9-aea7-4b0e-ba54-c02ddc3cb8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:28.015623 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3d1af9-aea7-4b0e-ba54-c02ddc3cb8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-556410504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=67188f82-76fa-455e-880e-ad028826c56b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b52014206e274c3bb9d0a81b1cd38807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:27:28Z,use_quota=True,user_id='3341ea0baedf4d6285856d2ea0a88aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:28.022251 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4192e222-dbeb-4add-8f35-c6b1f57b80b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:28.026791 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4192e222-dbeb-4add-8f35-c6b1f57b80b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:28.032400 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9298c66-fd77-4072-be59-2ef4f76d7de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:28.141461 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9298c66-fd77-4072-be59-2ef4f76d7de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '67188f82-76fa-455e-880e-ad028826c56b', 'volume_name': 'volume-67188f82-76fa-455e-880e-ad028826c56b', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710acfee0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:28.148080 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d61bd6-ba5d-4592-9bab-5f1718dcfef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:28.152820 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d61bd6-ba5d-4592-9bab-5f1718dcfef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:28.158557 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5a2f11-a85c-4e9e-a7e4-24f8f811dd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:28.159813 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Volume 67188f82-76fa-455e-880e-ad028826c56b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-67188f82-76fa-455e-880e-ad028826c56b', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710acfee0>}
Apr 16 21:27:28.160423 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Cloning 67188f82-76fa-455e-880e-ad028826c56b from image 88bbe9a7-19d2-4102-9634-058b7c590848  at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 16 21:27:28.173079 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:27:28.266456 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 27, 28, 175780)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:27:28.267849 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:27:28.268395 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Found cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 16 21:27:28.281725 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" released by "_prepare_image_cache_entry" :: held 0.111s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:27:28.286616 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Attempting to retrieve cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 16 21:27:28.300519 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 27, 28, 294260)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:27:28.301033 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:27:28.305069 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Creating from source image-volume e0e222dd-75a5-4728-81e0-d352ad2a6247 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 16 21:27:28.326122 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:28.569754 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] creating snapshot='volume-67188f82-76fa-455e-880e-ad028826c56b.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:27:31.781331 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] cloning 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247@volume-67188f82-76fa-455e-880e-ad028826c56b.clone_snap' to 'volume-67188f82-76fa-455e-880e-ad028826c56b' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:27:34.547826 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:27:34.549827 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:27:34.550242 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:27:35.367617 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:27:35.368337 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Marking volume 67188f82-76fa-455e-880e-ad028826c56b as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:27:35.445081 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Copying metadata from image 88bbe9a7-19d2-4102-9634-058b7c590848 to 67188f82-76fa-455e-880e-ad028826c56b. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 16 21:27:35.447979 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Creating volume glance metadata for volume 67188f82-76fa-455e-880e-ad028826c56b backed by image 88bbe9a7-19d2-4102-9634-058b7c590848 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 16 21:27:35.621258 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5a2f11-a85c-4e9e-a7e4-24f8f811dd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67188f82-76fa-455e-880e-ad028826c56b', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710acfee0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:35.627530 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb41aa4-1fd9-4afd-8859-7554942b556e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:35.709154 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Volume volume-67188f82-76fa-455e-880e-ad028826c56b (67188f82-76fa-455e-880e-ad028826c56b): created successfully
Apr 16 21:27:35.715204 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb41aa4-1fd9-4afd-8859-7554942b556e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:35.733451 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Flow 'volume_create_manager' (08034c8f-6d86-4e9b-a89f-e9ac1c49f2e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:27:35.841917 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1b8aa651-087c-49a9-b999-6d4d1dd4207a tempest-VolumesGetTest-1619616332 None] Created volume successfully.
Apr 16 21:27:37.476537 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:27:37.497922 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Flow 'volume_create_manager' (b1642980-f5d9-4404-b9f4-619a436a2004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:27:37.504784 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f6a7b1-a2de-421d-b5ef-0c1dbcf129be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:37.526187 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f6a7b1-a2de-421d-b5ef-0c1dbcf129be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:27:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-338181008',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d9efdf58-b0d7-4428-93bb-e37a7a7ad825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b52014206e274c3bb9d0a81b1cd38807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:27:37Z,use_quota=True,user_id='3341ea0baedf4d6285856d2ea0a88aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:37.532002 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (900757a7-4358-46ed-8fad-b1325e034d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:37.536976 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (900757a7-4358-46ed-8fad-b1325e034d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:37.542942 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6dd6bae-10f2-48d6-9142-5d22384d343e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:37.547953 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6dd6bae-10f2-48d6-9142-5d22384d343e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9efdf58-b0d7-4428-93bb-e37a7a7ad825', 'volume_name': 'volume-d9efdf58-b0d7-4428-93bb-e37a7a7ad825', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:37.558352 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (487e99fb-0c6b-4ec8-ac3d-e1664453cf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:37.562277 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (487e99fb-0c6b-4ec8-ac3d-e1664453cf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:37.568622 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56267e39-7376-4a58-8b35-dd9fcb85c1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:37.570403 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Volume d9efdf58-b0d7-4428-93bb-e37a7a7ad825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9efdf58-b0d7-4428-93bb-e37a7a7ad825', 'volume_size': 1}
Apr 16 21:27:37.570986 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] creating volume 'volume-d9efdf58-b0d7-4428-93bb-e37a7a7ad825' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:27:37.571992 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:38.829703 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:27:38.830415 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:27:38.834189 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56267e39-7376-4a58-8b35-dd9fcb85c1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9efdf58-b0d7-4428-93bb-e37a7a7ad825', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:38.839271 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11996d7b-c0f7-494f-bbb3-92db88493a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:38.940436 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Volume volume-d9efdf58-b0d7-4428-93bb-e37a7a7ad825 (d9efdf58-b0d7-4428-93bb-e37a7a7ad825): created successfully
Apr 16 21:27:38.946574 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11996d7b-c0f7-494f-bbb3-92db88493a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:38.954159 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Flow 'volume_create_manager' (b1642980-f5d9-4404-b9f4-619a436a2004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:27:38.975048 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-64df4430-da36-4739-b705-952b193b9734 tempest-VolumesBackupsAdminTest-1425647500 None] Terminate volume connection completed successfully.
Apr 16 21:27:38.997852 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-64df4430-da36-4739-b705-952b193b9734 tempest-VolumesBackupsAdminTest-1425647500 None] Remove volume export completed successfully.
Apr 16 21:27:39.177556 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-97042930-5f3e-4166-b108-c8e61cdae75c tempest-VolumesGetTest-1619616332 None] Created volume successfully.
Apr 16 21:27:39.614219 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-df21fea0-c3f6-49b1-bfc7-2ba92afc91bc tempest-VolumesGetTest-1619616332 None] Lock "b'cinder-d9efdf58-b0d7-4428-93bb-e37a7a7ad825-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:27:39.770727 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df21fea0-c3f6-49b1-bfc7-2ba92afc91bc tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:40.143545 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df21fea0-c3f6-49b1-bfc7-2ba92afc91bc tempest-VolumesGetTest-1619616332 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:27:40.145525 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df21fea0-c3f6-49b1-bfc7-2ba92afc91bc tempest-VolumesGetTest-1619616332 None] Volume volume-d9efdf58-b0d7-4428-93bb-e37a7a7ad825 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:27:40.465056 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df21fea0-c3f6-49b1-bfc7-2ba92afc91bc tempest-VolumesGetTest-1619616332 None] deleting rbd volume volume-d9efdf58-b0d7-4428-93bb-e37a7a7ad825 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:27:43.147748 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:27:43.170503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Flow 'volume_create_manager' (71c1a660-19e0-464e-b5fc-9e63e99ca891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:27:43.179386 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a28c44-e4b8-4020-9c52-6b58f22fc0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:43.195220 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a28c44-e4b8-4020-9c52-6b58f22fc0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:27:42Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_f1ba7d55-fe5a-4b81-ba86-3d6e7504fb5b',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=bbbd6e6a-ae33-44ca-ba1e-ec6d7832b6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b6e01c6acc41eeb83106b2e9830fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:27:43Z,use_quota=True,user_id='d59fae3205f9483d850750bfe5a304b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:43.200906 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2111ee21-029b-4dc5-86e0-07546d8338b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:43.205194 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2111ee21-029b-4dc5-86e0-07546d8338b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:43.213728 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef196e6b-2782-462b-927d-4127e7c818eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:43.217881 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef196e6b-2782-462b-927d-4127e7c818eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbbd6e6a-ae33-44ca-ba1e-ec6d7832b6c4', 'volume_name': 'volume-bbbd6e6a-ae33-44ca-ba1e-ec6d7832b6c4', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:43.223477 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d99c5a-e783-43f8-b0cf-f650d8d078f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:43.227490 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d99c5a-e783-43f8-b0cf-f650d8d078f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:43.232333 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8be7e79-2012-475e-9f91-a9f99bffcadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:43.233440 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Volume bbbd6e6a-ae33-44ca-ba1e-ec6d7832b6c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbbd6e6a-ae33-44ca-ba1e-ec6d7832b6c4', 'volume_size': 1}
Apr 16 21:27:43.233835 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] creating volume 'volume-bbbd6e6a-ae33-44ca-ba1e-ec6d7832b6c4' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:27:43.234711 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:44.243305 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:27:44.244843 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:27:44.249342 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8be7e79-2012-475e-9f91-a9f99bffcadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbbd6e6a-ae33-44ca-ba1e-ec6d7832b6c4', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:44.258400 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f88eeb-e3b0-4a23-865a-666fbbc56c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:27:44.371541 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Volume volume-bbbd6e6a-ae33-44ca-ba1e-ec6d7832b6c4 (bbbd6e6a-ae33-44ca-ba1e-ec6d7832b6c4): created successfully
Apr 16 21:27:44.371541 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f88eeb-e3b0-4a23-865a-666fbbc56c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:27:44.376763 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Flow 'volume_create_manager' (71c1a660-19e0-464e-b5fc-9e63e99ca891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:27:44.447228 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Created volume successfully.
Apr 16 21:27:45.263107 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:27:46.093660 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.830s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:27:46.094469 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bbbd6e6a-ae33-44ca-ba1e-ec6d7832b6c4', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'bbbd6e6a-ae33-44ca-ba1e-ec6d7832b6c4', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:27:46.110359 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Initialize volume connection completed successfully.
Apr 16 21:27:48.380212 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-df21fea0-c3f6-49b1-bfc7-2ba92afc91bc tempest-VolumesGetTest-1619616332 None] Created reservations ['06ee27c3-461a-48c5-89dc-bdd992725f30', 'c3a2fcfa-c8f8-44cf-b030-9aad87843c15', 'ef2c374b-d1da-4f1f-83fc-a47042bfe938', '898f6880-e5aa-48e7-aceb-27ad9d1e1884'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:27:48.595376 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df21fea0-c3f6-49b1-bfc7-2ba92afc91bc tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:48.617127 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df21fea0-c3f6-49b1-bfc7-2ba92afc91bc tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:48.641093 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-df21fea0-c3f6-49b1-bfc7-2ba92afc91bc tempest-VolumesGetTest-1619616332 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:27:48.646788 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-df21fea0-c3f6-49b1-bfc7-2ba92afc91bc tempest-VolumesGetTest-1619616332 None] Deleted volume successfully.
Apr 16 21:27:48.734196 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-df21fea0-c3f6-49b1-bfc7-2ba92afc91bc tempest-VolumesGetTest-1619616332 None] Lock "b'cinder-d9efdf58-b0d7-4428-93bb-e37a7a7ad825-delete_volume'" released by "delete_volume" :: held 9.120s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:27:49.446934 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a965c8c2-69f4-4c2a-8eb9-5105b73d45b5 tempest-VolumesGetTest-1619616332 None] Lock "b'cinder-67188f82-76fa-455e-880e-ad028826c56b-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:27:49.602073 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a965c8c2-69f4-4c2a-8eb9-5105b73d45b5 tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:49.988575 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a965c8c2-69f4-4c2a-8eb9-5105b73d45b5 tempest-VolumesGetTest-1619616332 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:27:50.118604 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a965c8c2-69f4-4c2a-8eb9-5105b73d45b5 tempest-VolumesGetTest-1619616332 None] deleting rbd volume volume-67188f82-76fa-455e-880e-ad028826c56b {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:27:50.229706 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Terminate volume connection completed successfully.
Apr 16 21:27:50.273117 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-88c18561-10ed-4592-b66c-6c351b6c653b tempest-VolumesBackupsAdminTest-1425647500 None] Remove volume export completed successfully.
Apr 16 21:27:51.797260 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-6aeee14c-5220-4cac-9ea7-db54fc33cbd5 tempest-VolumesBackupsAdminTest-1425647500 None] Lock "b'cinder-bbbd6e6a-ae33-44ca-ba1e-ec6d7832b6c4-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:27:52.083263 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6aeee14c-5220-4cac-9ea7-db54fc33cbd5 tempest-VolumesBackupsAdminTest-1425647500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:27:55.172625 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6aeee14c-5220-4cac-9ea7-db54fc33cbd5 tempest-VolumesBackupsAdminTest-1425647500 None] Volume volume-bbbd6e6a-ae33-44ca-ba1e-ec6d7832b6c4 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:27:56.006466 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6aeee14c-5220-4cac-9ea7-db54fc33cbd5 tempest-VolumesBackupsAdminTest-1425647500 None] deleting rbd volume volume-bbbd6e6a-ae33-44ca-ba1e-ec6d7832b6c4 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:27:58.366039 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a965c8c2-69f4-4c2a-8eb9-5105b73d45b5 tempest-VolumesGetTest-1619616332 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:27:58.723385 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a965c8c2-69f4-4c2a-8eb9-5105b73d45b5 tempest-VolumesGetTest-1619616332 None] deleting parent snapshot volume-67188f82-76fa-455e-880e-ad028826c56b.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:28:03.102469 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-a965c8c2-69f4-4c2a-8eb9-5105b73d45b5 tempest-VolumesGetTest-1619616332 None] Created reservations ['be33e2ee-b436-4c87-827a-ab29f55d59a5', 'ae5a5148-35c4-49fd-9343-187dd3387e2c', 'e36f4bd2-283f-409a-8e80-d0584cafae0b', '2ae36219-1423-4929-8398-7d1c080cadb4'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:28:03.406644 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a965c8c2-69f4-4c2a-8eb9-5105b73d45b5 tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:28:03.453463 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a965c8c2-69f4-4c2a-8eb9-5105b73d45b5 tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:28:03.539950 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-a965c8c2-69f4-4c2a-8eb9-5105b73d45b5 tempest-VolumesGetTest-1619616332 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:28:03.556645 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a965c8c2-69f4-4c2a-8eb9-5105b73d45b5 tempest-VolumesGetTest-1619616332 None] Deleted volume successfully.
Apr 16 21:28:03.560919 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c0fb1b15-3466-4f91-9982-df02415f02ae tempest-VolumesGetTest-1619616332 None] Lock "b'cinder-4104530d-c326-425d-9d32-330b7ab763f3-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:28:03.694743 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a965c8c2-69f4-4c2a-8eb9-5105b73d45b5 tempest-VolumesGetTest-1619616332 None] Lock "b'cinder-67188f82-76fa-455e-880e-ad028826c56b-delete_volume'" released by "delete_volume" :: held 14.248s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:28:03.704406 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c0fb1b15-3466-4f91-9982-df02415f02ae tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:28:04.159858 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c0fb1b15-3466-4f91-9982-df02415f02ae tempest-VolumesGetTest-1619616332 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:28:04.160469 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c0fb1b15-3466-4f91-9982-df02415f02ae tempest-VolumesGetTest-1619616332 None] Volume volume-4104530d-c326-425d-9d32-330b7ab763f3 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:28:04.401160 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c0fb1b15-3466-4f91-9982-df02415f02ae tempest-VolumesGetTest-1619616332 None] deleting rbd volume volume-4104530d-c326-425d-9d32-330b7ab763f3 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:28:04.586967 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-6aeee14c-5220-4cac-9ea7-db54fc33cbd5 tempest-VolumesBackupsAdminTest-1425647500 None] Created reservations ['ec6a4a30-50b3-4403-acc3-1fd9b9c3a325', '508501d4-5b6c-4446-ab17-b65e3af7d542', '4bccce01-10ad-43ea-9b96-d1d9df533829', '1a0296a8-2bcf-4ca4-8ece-8d68baed7441'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:28:04.793288 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6aeee14c-5220-4cac-9ea7-db54fc33cbd5 tempest-VolumesBackupsAdminTest-1425647500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:28:04.830916 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6aeee14c-5220-4cac-9ea7-db54fc33cbd5 tempest-VolumesBackupsAdminTest-1425647500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:28:04.857450 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-6aeee14c-5220-4cac-9ea7-db54fc33cbd5 tempest-VolumesBackupsAdminTest-1425647500 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:28:04.862134 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6aeee14c-5220-4cac-9ea7-db54fc33cbd5 tempest-VolumesBackupsAdminTest-1425647500 None] Deleted volume successfully.
Apr 16 21:28:04.960350 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-6aeee14c-5220-4cac-9ea7-db54fc33cbd5 tempest-VolumesBackupsAdminTest-1425647500 None] Lock "b'cinder-bbbd6e6a-ae33-44ca-ba1e-ec6d7832b6c4-delete_volume'" released by "delete_volume" :: held 13.163s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:28:07.918462 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:28:07.947142 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Flow 'volume_create_manager' (a23cb18f-a3c7-42df-b1bc-3b631b0bebbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:28:07.954263 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f883c3c3-c316-4466-a17d-96a311f94a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:28:07.976384 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f883c3c3-c316-4466-a17d-96a311f94a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-577215078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3970c74e-3013-4b29-b21d-fdea46bf38d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b6e01c6acc41eeb83106b2e9830fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:28:08Z,use_quota=True,user_id='d59fae3205f9483d850750bfe5a304b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:28:07.981986 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d448f333-38c0-4690-a6d1-e23f66a20b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:28:07.986990 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d448f333-38c0-4690-a6d1-e23f66a20b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:28:07.993583 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56183f45-921e-4c00-a283-595267b3221e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:28:07.999033 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56183f45-921e-4c00-a283-595267b3221e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3970c74e-3013-4b29-b21d-fdea46bf38d1', 'volume_name': 'volume-3970c74e-3013-4b29-b21d-fdea46bf38d1', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:28:08.004266 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d70abb-f043-4f11-b1c1-81a493747bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:28:08.008677 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d70abb-f043-4f11-b1c1-81a493747bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:28:08.013711 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0648b2e4-2723-4d28-b5bc-98f31209da15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:28:08.014825 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Volume 3970c74e-3013-4b29-b21d-fdea46bf38d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3970c74e-3013-4b29-b21d-fdea46bf38d1', 'volume_size': 1}
Apr 16 21:28:08.015230 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] creating volume 'volume-3970c74e-3013-4b29-b21d-fdea46bf38d1' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:28:08.016038 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:28:08.039922 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:28:08.060025 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Flow 'volume_create_manager' (6789a30b-b3b0-476d-a7d5-cdebadff7da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:28:08.066979 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71408780-e98d-44a8-a165-253cb98fe840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:28:08.082750 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71408780-e98d-44a8-a165-253cb98fe840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-876437697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=49d5fd0d-87e4-490a-a0d3-5f24e6948347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f8dfa11e9b410cbbd59ffe32afeb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:28:08Z,use_quota=True,user_id='37443a4e933a4873bb039b06efaec98f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:28:08.088853 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3efc29a-ed30-4b1c-af54-cbf5a4c9a8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:28:08.093885 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3efc29a-ed30-4b1c-af54-cbf5a4c9a8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:28:08.100051 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d580668-c3e1-4b8a-a278-3e593108853e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:28:08.104343 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d580668-c3e1-4b8a-a278-3e593108853e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49d5fd0d-87e4-490a-a0d3-5f24e6948347', 'volume_name': 'volume-49d5fd0d-87e4-490a-a0d3-5f24e6948347', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:28:08.109669 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a166b0-45c0-4801-a9b7-bee144d920ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:28:08.114260 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a166b0-45c0-4801-a9b7-bee144d920ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:28:08.119251 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d8d1df-8514-4366-91e6-6b25eb3cd17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:28:08.120436 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Volume 49d5fd0d-87e4-490a-a0d3-5f24e6948347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49d5fd0d-87e4-490a-a0d3-5f24e6948347', 'volume_size': 1}
Apr 16 21:28:08.120835 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] creating volume 'volume-49d5fd0d-87e4-490a-a0d3-5f24e6948347' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:28:08.121751 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:28:09.346520 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:28:09.346520 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:28:09.350252 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0648b2e4-2723-4d28-b5bc-98f31209da15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3970c74e-3013-4b29-b21d-fdea46bf38d1', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:28:09.355460 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f759ecf-ea2c-4d1f-aed3-41300c88320c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:28:09.454455 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Volume volume-3970c74e-3013-4b29-b21d-fdea46bf38d1 (3970c74e-3013-4b29-b21d-fdea46bf38d1): created successfully
Apr 16 21:28:09.462577 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f759ecf-ea2c-4d1f-aed3-41300c88320c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:28:09.471893 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Flow 'volume_create_manager' (a23cb18f-a3c7-42df-b1bc-3b631b0bebbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:28:09.489946 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:28:09.490765 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:28:09.498589 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d8d1df-8514-4366-91e6-6b25eb3cd17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49d5fd0d-87e4-490a-a0d3-5f24e6948347', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:28:09.513963 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd947b9-bc42-454d-b610-a012c14f38f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:28:09.580506 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-41f8a179-2452-49f6-a06c-04fdca3f9e05 tempest-VolumesBackupsAdminTest-1425647500 None] Created volume successfully.
Apr 16 21:28:09.633424 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Volume volume-49d5fd0d-87e4-490a-a0d3-5f24e6948347 (49d5fd0d-87e4-490a-a0d3-5f24e6948347): created successfully
Apr 16 21:28:09.661450 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd947b9-bc42-454d-b610-a012c14f38f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:28:09.668455 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Flow 'volume_create_manager' (6789a30b-b3b0-476d-a7d5-cdebadff7da0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:28:09.886071 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a9372dbd-db01-49cf-88cb-778019089a40 tempest-AttachVolumeNegativeTest-1739448039 None] Created volume successfully.
Apr 16 21:28:10.763032 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-86b60595-4f7a-4b80-814f-2d9d6d09f316 tempest-VolumesBackupsAdminTest-1425647500 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-16T21:28:09Z,data_timestamp=2022-04-16T21:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-31396608',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=424ec57b-a5e2-458a-9a4e-5906dac3b04b,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='b2b6e01c6acc41eeb83106b2e9830fe4',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='d59fae3205f9483d850750bfe5a304b7',volume_id=3970c74e-3013-4b29-b21d-fdea46bf38d1)
Apr 16 21:28:10.766912 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.backup.rpcapi [None req-86b60595-4f7a-4b80-814f-2d9d6d09f316 tempest-VolumesBackupsAdminTest-1425647500 None] continue_backup in rpcapi backup_id 424ec57b-a5e2-458a-9a4e-5906dac3b04b {{(pid=130674) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Apr 16 21:28:10.939980 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-86b60595-4f7a-4b80-814f-2d9d6d09f316 tempest-VolumesBackupsAdminTest-1425647500 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:28:11.389410 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-f5e8e51b-6899-4118-8867-82b070faa316 req-5bce9bca-706d-46d5-96d7-dc7ee30a6604 tempest-AttachVolumeNegativeTest-1739448039 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:28:11.881549 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-86b60595-4f7a-4b80-814f-2d9d6d09f316 tempest-VolumesBackupsAdminTest-1425647500 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.941s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:28:11.882704 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-86b60595-4f7a-4b80-814f-2d9d6d09f316 tempest-VolumesBackupsAdminTest-1425647500 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3970c74e-3013-4b29-b21d-fdea46bf38d1', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '3970c74e-3013-4b29-b21d-fdea46bf38d1', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:28:11.913818 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-86b60595-4f7a-4b80-814f-2d9d6d09f316 tempest-VolumesBackupsAdminTest-1425647500 None] Initialize volume connection completed successfully.
Apr 16 21:28:12.358863 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-f5e8e51b-6899-4118-8867-82b070faa316 req-5bce9bca-706d-46d5-96d7-dc7ee30a6604 tempest-AttachVolumeNegativeTest-1739448039 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.970s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:28:12.359680 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-f5e8e51b-6899-4118-8867-82b070faa316 req-5bce9bca-706d-46d5-96d7-dc7ee30a6604 tempest-AttachVolumeNegativeTest-1739448039 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-49d5fd0d-87e4-490a-a0d3-5f24e6948347', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '49d5fd0d-87e4-490a-a0d3-5f24e6948347', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:28:12.558154 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-f5e8e51b-6899-4118-8867-82b070faa316 req-5bce9bca-706d-46d5-96d7-dc7ee30a6604 tempest-AttachVolumeNegativeTest-1739448039 None] Connection info returned from driver {'name': 'volumes/volume-49d5fd0d-87e4-490a-a0d3-5f24e6948347', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '49d5fd0d-87e4-490a-a0d3-5f24e6948347', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '40965b71-0cdb-48d6-aa0f-e3f025039450'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:28:12.705908 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-f5e8e51b-6899-4118-8867-82b070faa316 req-5bce9bca-706d-46d5-96d7-dc7ee30a6604 tempest-AttachVolumeNegativeTest-1739448039 None] attachment_update completed successfully.
Apr 16 21:28:12.853482 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-c0fb1b15-3466-4f91-9982-df02415f02ae tempest-VolumesGetTest-1619616332 None] Created reservations ['35943484-2804-4ab9-b420-d2071069dc17', '0d3c0fb0-d1a2-406e-ab88-5251837b4bd3', '0e2fd029-19b2-4150-9403-f9158b61008e', '0d01a7ba-14d7-4d83-9fd0-6ad478118555'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:28:13.062276 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c0fb1b15-3466-4f91-9982-df02415f02ae tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:28:13.104442 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c0fb1b15-3466-4f91-9982-df02415f02ae tempest-VolumesGetTest-1619616332 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:28:13.171705 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-c0fb1b15-3466-4f91-9982-df02415f02ae tempest-VolumesGetTest-1619616332 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:28:13.175590 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c0fb1b15-3466-4f91-9982-df02415f02ae tempest-VolumesGetTest-1619616332 None] Deleted volume successfully.
Apr 16 21:28:13.287618 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c0fb1b15-3466-4f91-9982-df02415f02ae tempest-VolumesGetTest-1619616332 None] Lock "b'cinder-4104530d-c326-425d-9d32-330b7ab763f3-delete_volume'" released by "delete_volume" :: held 9.727s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:28:19.654575 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-98112fda-5512-4df5-a710-3434d2912c68 req-56761259-63ab-431f-bfe4-53dce06cb4a3 tempest-AttachVolumeNegativeTest-1739448039 None] Terminate volume connection completed successfully.
Apr 16 21:28:19.655234 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-98112fda-5512-4df5-a710-3434d2912c68 req-56761259-63ab-431f-bfe4-53dce06cb4a3 tempest-AttachVolumeNegativeTest-1739448039 None] Deleting attachment 40965b71-0cdb-48d6-aa0f-e3f025039450. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:28:21.632040 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-86b60595-4f7a-4b80-814f-2d9d6d09f316 tempest-VolumesBackupsAdminTest-1425647500 None] Terminate volume connection completed successfully.
Apr 16 21:28:21.668966 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-86b60595-4f7a-4b80-814f-2d9d6d09f316 tempest-VolumesBackupsAdminTest-1425647500 None] Remove volume export completed successfully.
Apr 16 21:28:25.468778 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:28:25.469489 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:28:25.543161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:28:25.605585 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:28:38.551243 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c7cc6329-6e9b-4674-be2b-159abeec83b0 tempest-VolumesBackupsAdminTest-1425647500 None] Lock "b'cinder-3970c74e-3013-4b29-b21d-fdea46bf38d1-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:28:38.710073 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c7cc6329-6e9b-4674-be2b-159abeec83b0 tempest-VolumesBackupsAdminTest-1425647500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:28:41.615261 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c7cc6329-6e9b-4674-be2b-159abeec83b0 tempest-VolumesBackupsAdminTest-1425647500 None] Volume volume-3970c74e-3013-4b29-b21d-fdea46bf38d1 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:28:42.621729 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c7cc6329-6e9b-4674-be2b-159abeec83b0 tempest-VolumesBackupsAdminTest-1425647500 None] deleting rbd volume volume-3970c74e-3013-4b29-b21d-fdea46bf38d1 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:28:50.384497 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-c7cc6329-6e9b-4674-be2b-159abeec83b0 tempest-VolumesBackupsAdminTest-1425647500 None] Created reservations ['e14bf229-7d50-4a07-9768-bb47b3d82014', '35f2da45-bf1e-4f92-bc37-6d5d27abf5be', '94a2aea6-4c8f-46fd-8074-1ac0e7da1136', '1c2413f2-a915-4635-95e3-99ed0f8b5b31'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:28:50.688024 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c7cc6329-6e9b-4674-be2b-159abeec83b0 tempest-VolumesBackupsAdminTest-1425647500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:28:50.779706 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c7cc6329-6e9b-4674-be2b-159abeec83b0 tempest-VolumesBackupsAdminTest-1425647500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:28:50.848106 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-c7cc6329-6e9b-4674-be2b-159abeec83b0 tempest-VolumesBackupsAdminTest-1425647500 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:28:50.853168 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c7cc6329-6e9b-4674-be2b-159abeec83b0 tempest-VolumesBackupsAdminTest-1425647500 None] Deleted volume successfully.
Apr 16 21:28:50.921381 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c7cc6329-6e9b-4674-be2b-159abeec83b0 tempest-VolumesBackupsAdminTest-1425647500 None] Lock "b'cinder-3970c74e-3013-4b29-b21d-fdea46bf38d1-delete_volume'" released by "delete_volume" :: held 12.369s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:28:51.803350 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0ff414d8-60a0-4465-ba17-34e2b9fc865b tempest-VolumesBackupsAdminTest-1425647500 None] Lock "b'cinder-8a31c3b5-5649-44bf-8b54-3af9e8bcbc48-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:28:51.904740 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0ff414d8-60a0-4465-ba17-34e2b9fc865b tempest-VolumesBackupsAdminTest-1425647500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:28:54.551285 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0ff414d8-60a0-4465-ba17-34e2b9fc865b tempest-VolumesBackupsAdminTest-1425647500 None] Volume volume-8a31c3b5-5649-44bf-8b54-3af9e8bcbc48 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:28:55.316063 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0ff414d8-60a0-4465-ba17-34e2b9fc865b tempest-VolumesBackupsAdminTest-1425647500 None] deleting rbd volume volume-8a31c3b5-5649-44bf-8b54-3af9e8bcbc48 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:29:01.968600 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-0ff414d8-60a0-4465-ba17-34e2b9fc865b tempest-VolumesBackupsAdminTest-1425647500 None] Created reservations ['4f214c1d-9707-4b72-b171-ff49fee1a85b', '3de6d9a2-af15-47a5-a18a-c74142676d82', 'a0423f7c-38ff-4950-985d-c74d314536b6', 'f48ebbd8-da21-41fe-b472-4e78b26a15cb'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:29:02.184477 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0ff414d8-60a0-4465-ba17-34e2b9fc865b tempest-VolumesBackupsAdminTest-1425647500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:29:02.240397 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0ff414d8-60a0-4465-ba17-34e2b9fc865b tempest-VolumesBackupsAdminTest-1425647500 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:29:02.323596 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-0ff414d8-60a0-4465-ba17-34e2b9fc865b tempest-VolumesBackupsAdminTest-1425647500 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:29:02.328847 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0ff414d8-60a0-4465-ba17-34e2b9fc865b tempest-VolumesBackupsAdminTest-1425647500 None] Deleted volume successfully.
Apr 16 21:29:02.399437 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0ff414d8-60a0-4465-ba17-34e2b9fc865b tempest-VolumesBackupsAdminTest-1425647500 None] Lock "b'cinder-8a31c3b5-5649-44bf-8b54-3af9e8bcbc48-delete_volume'" released by "delete_volume" :: held 10.596s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:29:09.050587 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:29:09.072511 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Flow 'volume_create_manager' (ea05a2e0-9070-4366-91ec-1adfc4b37753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:29:09.081333 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103dc4ee-b224-42a2-be12-7765d115bd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:29:09.099418 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103dc4ee-b224-42a2-be12-7765d115bd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1571015093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0896b91c-6587-4b5f-9884-cbadd1682f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fac87f4e61e492aa976384f5d0adb01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:29:09Z,use_quota=True,user_id='8e2a5ee58bf341a9a43aa07514f03772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:29:09.105601 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54a6c2a-ada0-43c9-8d94-bd404f4a188e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:29:09.110861 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54a6c2a-ada0-43c9-8d94-bd404f4a188e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:29:09.122926 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f537ddc-fce4-4d2b-acc2-3d72069a3e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:29:09.233171 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f537ddc-fce4-4d2b-acc2-3d72069a3e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0896b91c-6587-4b5f-9884-cbadd1682f01', 'volume_name': 'volume-0896b91c-6587-4b5f-9884-cbadd1682f01', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7109c6130>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:29:09.248781 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec7580e-982a-4e23-94c8-3fcb48c5c37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:29:09.253774 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec7580e-982a-4e23-94c8-3fcb48c5c37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:29:09.259785 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f4b8899-b187-4e55-aa8a-483af07db094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:29:09.261710 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Volume 0896b91c-6587-4b5f-9884-cbadd1682f01: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0896b91c-6587-4b5f-9884-cbadd1682f01', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7109c6130>}
Apr 16 21:29:09.262533 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Cloning 0896b91c-6587-4b5f-9884-cbadd1682f01 from image 88bbe9a7-19d2-4102-9634-058b7c590848  at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 16 21:29:09.279095 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" acquired by "_prepare_image_cache_entry" :: waited 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:29:09.345414 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 29, 9, 288706)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:29:09.346125 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:29:09.346684 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Found cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 16 21:29:09.356676 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" released by "_prepare_image_cache_entry" :: held 0.073s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:29:09.356676 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Attempting to retrieve cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 16 21:29:09.360765 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 29, 9, 358055)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:29:09.361545 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:29:09.362294 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Creating from source image-volume e0e222dd-75a5-4728-81e0-d352ad2a6247 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 16 21:29:09.387798 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:29:09.767800 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] creating snapshot='volume-0896b91c-6587-4b5f-9884-cbadd1682f01.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:29:11.911881 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] cloning 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247@volume-0896b91c-6587-4b5f-9884-cbadd1682f01.clone_snap' to 'volume-0896b91c-6587-4b5f-9884-cbadd1682f01' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:29:14.116165 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:29:14.119852 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:29:14.120728 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:29:14.904838 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:29:14.905788 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Marking volume 0896b91c-6587-4b5f-9884-cbadd1682f01 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:29:14.996614 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Copying metadata from image 88bbe9a7-19d2-4102-9634-058b7c590848 to 0896b91c-6587-4b5f-9884-cbadd1682f01. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 16 21:29:14.996614 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Creating volume glance metadata for volume 0896b91c-6587-4b5f-9884-cbadd1682f01 backed by image 88bbe9a7-19d2-4102-9634-058b7c590848 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 16 21:29:15.240579 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f4b8899-b187-4e55-aa8a-483af07db094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0896b91c-6587-4b5f-9884-cbadd1682f01', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7109c6130>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:29:15.248929 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c44132-f958-4792-94cf-b8017fc8ad60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:29:15.321063 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Volume volume-0896b91c-6587-4b5f-9884-cbadd1682f01 (0896b91c-6587-4b5f-9884-cbadd1682f01): created successfully
Apr 16 21:29:15.325176 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c44132-f958-4792-94cf-b8017fc8ad60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:29:15.331654 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Flow 'volume_create_manager' (ea05a2e0-9070-4366-91ec-1adfc4b37753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:29:15.424892 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9b8e2997-0ff1-4ed0-bb8c-923d2c5853ec tempest-VolumesImageMetadata-1418129617 None] Created volume successfully.
Apr 16 21:29:17.013542 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-78438e64-2fd0-4f71-b357-77ad1340247f tempest-VolumesImageMetadata-1418129617 None] Lock "b'cinder-0896b91c-6587-4b5f-9884-cbadd1682f01-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:29:17.170186 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-78438e64-2fd0-4f71-b357-77ad1340247f tempest-VolumesImageMetadata-1418129617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:29:17.396361 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-78438e64-2fd0-4f71-b357-77ad1340247f tempest-VolumesImageMetadata-1418129617 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:29:17.592871 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-78438e64-2fd0-4f71-b357-77ad1340247f tempest-VolumesImageMetadata-1418129617 None] deleting rbd volume volume-0896b91c-6587-4b5f-9884-cbadd1682f01 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:29:24.938937 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-78438e64-2fd0-4f71-b357-77ad1340247f tempest-VolumesImageMetadata-1418129617 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:29:25.123266 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-78438e64-2fd0-4f71-b357-77ad1340247f tempest-VolumesImageMetadata-1418129617 None] deleting parent snapshot volume-0896b91c-6587-4b5f-9884-cbadd1682f01.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:29:28.584828 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:29:28.586660 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:29:28.683979 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:29:28.731501 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:29:28.875293 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-78438e64-2fd0-4f71-b357-77ad1340247f tempest-VolumesImageMetadata-1418129617 None] Created reservations ['5d333335-4754-4507-856f-398fc96a6c6d', 'b63bf837-eaf2-4ca7-94dc-03effb93f2e9', 'af52b671-a814-438a-a191-35cbfa7fd185', '3ad668cc-4f17-41e9-85e0-fb115593c648'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:29:29.094567 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-78438e64-2fd0-4f71-b357-77ad1340247f tempest-VolumesImageMetadata-1418129617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:29:29.149244 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-78438e64-2fd0-4f71-b357-77ad1340247f tempest-VolumesImageMetadata-1418129617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:29:29.210552 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-78438e64-2fd0-4f71-b357-77ad1340247f tempest-VolumesImageMetadata-1418129617 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:29:29.214456 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-78438e64-2fd0-4f71-b357-77ad1340247f tempest-VolumesImageMetadata-1418129617 None] Deleted volume successfully.
Apr 16 21:29:29.298470 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-78438e64-2fd0-4f71-b357-77ad1340247f tempest-VolumesImageMetadata-1418129617 None] Lock "b'cinder-0896b91c-6587-4b5f-9884-cbadd1682f01-delete_volume'" released by "delete_volume" :: held 12.285s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:29:34.224697 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:29:34.244979 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Flow 'volume_create_manager' (1ecced56-71ae-4bef-8ced-49dfd505fcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:29:34.253466 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a7ff36-ec3e-4014-afd4-f467d9c1f2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:29:34.276745 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a7ff36-ec3e-4014-afd4-f467d9c1f2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-528615632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0325d93d-67ca-449e-bfcf-95605af1ba99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9a42fbaedfa48bf9d1306ceb85b0e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:29:34Z,use_quota=True,user_id='cf6771a45e3242d6ad4883d3b6ef314f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:29:34.296597 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3c8409-8678-4adb-a1f6-4b8217573548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:29:34.301456 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3c8409-8678-4adb-a1f6-4b8217573548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:29:34.307018 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522cb6a1-2551-4c68-95c0-71861836718f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:29:34.311423 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522cb6a1-2551-4c68-95c0-71861836718f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0325d93d-67ca-449e-bfcf-95605af1ba99', 'volume_name': 'volume-0325d93d-67ca-449e-bfcf-95605af1ba99', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:29:34.317324 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5654be7-6516-447c-8f88-e2373592df91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:29:34.321276 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5654be7-6516-447c-8f88-e2373592df91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:29:34.326030 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d105223-0d40-43d5-8d52-4b52d9656bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:29:34.327225 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Volume 0325d93d-67ca-449e-bfcf-95605af1ba99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0325d93d-67ca-449e-bfcf-95605af1ba99', 'volume_size': 1}
Apr 16 21:29:34.327624 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] creating volume 'volume-0325d93d-67ca-449e-bfcf-95605af1ba99' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:29:34.328453 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:29:35.726964 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:29:35.727504 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:29:35.731503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d105223-0d40-43d5-8d52-4b52d9656bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0325d93d-67ca-449e-bfcf-95605af1ba99', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:29:35.736127 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490aeb69-9a31-4c92-9d15-0ef82082cb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:29:35.790960 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Volume volume-0325d93d-67ca-449e-bfcf-95605af1ba99 (0325d93d-67ca-449e-bfcf-95605af1ba99): created successfully
Apr 16 21:29:35.795492 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490aeb69-9a31-4c92-9d15-0ef82082cb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:29:35.801045 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Flow 'volume_create_manager' (1ecced56-71ae-4bef-8ced-49dfd505fcff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:29:35.865590 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-98134a48-d991-4f42-946c-c55956eea1f8 tempest-VolumesNegativeTest-900060710 None] Created volume successfully.
Apr 16 21:30:10.575805 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-18e33654-8138-444a-9707-9c33c12a5aa6 tempest-VolumesNegativeTest-900060710 None] Lock "b'cinder-0325d93d-67ca-449e-bfcf-95605af1ba99-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:30:10.731898 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-18e33654-8138-444a-9707-9c33c12a5aa6 tempest-VolumesNegativeTest-900060710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:11.081934 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-18e33654-8138-444a-9707-9c33c12a5aa6 tempest-VolumesNegativeTest-900060710 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:30:11.082366 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-18e33654-8138-444a-9707-9c33c12a5aa6 tempest-VolumesNegativeTest-900060710 None] Volume volume-0325d93d-67ca-449e-bfcf-95605af1ba99 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:30:11.231321 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-18e33654-8138-444a-9707-9c33c12a5aa6 tempest-VolumesNegativeTest-900060710 None] deleting rbd volume volume-0325d93d-67ca-449e-bfcf-95605af1ba99 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:30:16.705470 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:30:16.741612 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Flow 'volume_create_manager' (b74f8ab7-a457-489d-97b4-bc398a1a1cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:30:16.754066 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bfa3ea-b5ce-4995-ba30-43e9fc444d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:30:16.773820 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bfa3ea-b5ce-4995-ba30-43e9fc444d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1617463904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3d395e17-7dd9-4d66-a088-40c6e23eeb95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f8dfa11e9b410cbbd59ffe32afeb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:30:17Z,use_quota=True,user_id='37443a4e933a4873bb039b06efaec98f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:30:16.786515 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea281447-9cc8-4111-ada9-4fba27fdedeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:30:16.790931 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea281447-9cc8-4111-ada9-4fba27fdedeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:30:16.797998 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576ef091-ac96-4227-8978-8296e41c6a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:30:16.802592 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576ef091-ac96-4227-8978-8296e41c6a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d395e17-7dd9-4d66-a088-40c6e23eeb95', 'volume_name': 'volume-3d395e17-7dd9-4d66-a088-40c6e23eeb95', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:30:16.808855 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcb8849-fc92-4f7c-9daa-435267c56fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:30:16.815267 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcb8849-fc92-4f7c-9daa-435267c56fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:30:16.823266 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adba4230-5e87-485f-b3d3-8550d73b2c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:30:16.825493 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Volume 3d395e17-7dd9-4d66-a088-40c6e23eeb95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d395e17-7dd9-4d66-a088-40c6e23eeb95', 'volume_size': 1}
Apr 16 21:30:16.825913 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] creating volume 'volume-3d395e17-7dd9-4d66-a088-40c6e23eeb95' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:30:16.826594 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:18.195733 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:30:18.197215 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:30:18.206166 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adba4230-5e87-485f-b3d3-8550d73b2c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d395e17-7dd9-4d66-a088-40c6e23eeb95', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:30:18.212763 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1559d0-6392-46c4-9a80-ced7bcaf9b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:30:18.300131 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Volume volume-3d395e17-7dd9-4d66-a088-40c6e23eeb95 (3d395e17-7dd9-4d66-a088-40c6e23eeb95): created successfully
Apr 16 21:30:18.312017 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1559d0-6392-46c4-9a80-ced7bcaf9b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:30:18.339935 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Flow 'volume_create_manager' (b74f8ab7-a457-489d-97b4-bc398a1a1cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:30:18.443251 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-bce651ff-f406-4b43-b005-7f250b1c07c5 tempest-AttachVolumeNegativeTest-1739448039 None] Created volume successfully.
Apr 16 21:30:19.372410 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-18e33654-8138-444a-9707-9c33c12a5aa6 tempest-VolumesNegativeTest-900060710 None] Created reservations ['945f8630-cacb-4ead-92a6-a6dc40565801', '8928ad0b-2111-4f37-afbb-9f284d082c62', 'b7312882-707d-4ef5-8fb7-84aa15ab8ecf', 'c2970a12-6919-4bdf-952d-73ce95ebf0a4'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:30:19.695653 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-18e33654-8138-444a-9707-9c33c12a5aa6 tempest-VolumesNegativeTest-900060710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:19.789873 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-18e33654-8138-444a-9707-9c33c12a5aa6 tempest-VolumesNegativeTest-900060710 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:19.875262 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-18e33654-8138-444a-9707-9c33c12a5aa6 tempest-VolumesNegativeTest-900060710 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:30:19.879789 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-18e33654-8138-444a-9707-9c33c12a5aa6 tempest-VolumesNegativeTest-900060710 None] Deleted volume successfully.
Apr 16 21:30:20.014584 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-f96c710f-73c6-4acc-ad91-ad4e148cd312 req-1c0d97c3-ff8c-4b06-95fa-1d230ad86dcd tempest-AttachVolumeNegativeTest-1739448039 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:30:20.065009 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-18e33654-8138-444a-9707-9c33c12a5aa6 tempest-VolumesNegativeTest-900060710 None] Lock "b'cinder-0325d93d-67ca-449e-bfcf-95605af1ba99-delete_volume'" released by "delete_volume" :: held 9.490s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:30:20.896591 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-f96c710f-73c6-4acc-ad91-ad4e148cd312 req-1c0d97c3-ff8c-4b06-95fa-1d230ad86dcd tempest-AttachVolumeNegativeTest-1739448039 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.879s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:30:20.896591 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-f96c710f-73c6-4acc-ad91-ad4e148cd312 req-1c0d97c3-ff8c-4b06-95fa-1d230ad86dcd tempest-AttachVolumeNegativeTest-1739448039 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3d395e17-7dd9-4d66-a088-40c6e23eeb95', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '3d395e17-7dd9-4d66-a088-40c6e23eeb95', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:30:21.026052 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-f96c710f-73c6-4acc-ad91-ad4e148cd312 req-1c0d97c3-ff8c-4b06-95fa-1d230ad86dcd tempest-AttachVolumeNegativeTest-1739448039 None] Connection info returned from driver {'name': 'volumes/volume-3d395e17-7dd9-4d66-a088-40c6e23eeb95', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3d395e17-7dd9-4d66-a088-40c6e23eeb95', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f7802e76-6e28-4669-8d84-ae5084125604'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:30:21.162640 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-f96c710f-73c6-4acc-ad91-ad4e148cd312 req-1c0d97c3-ff8c-4b06-95fa-1d230ad86dcd tempest-AttachVolumeNegativeTest-1739448039 None] attachment_update completed successfully.
Apr 16 21:30:25.970955 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:30:26.014676 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Flow 'volume_create_manager' (6320be1d-7432-4fe1-8cc0-8cbf5004fb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:30:26.027199 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f40349-2713-4b29-ae5d-93d077c25830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:30:26.079410 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f40349-2713-4b29-ae5d-93d077c25830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1269767345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a07dbc06-fbe9-49d8-83a5-a410fa92c0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9271eec1c9f04b1ca44c791eca985440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:30:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:30:26Z,use_quota=True,user_id='6ac6dd3472714711861e41f292ea36b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:30:26.086740 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fbedfe-cd66-486d-9226-ffdbdbbf48cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:30:26.091630 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fbedfe-cd66-486d-9226-ffdbdbbf48cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:30:26.097239 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3620a35e-b5d0-40a1-b284-3f86673a8b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:30:26.102297 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3620a35e-b5d0-40a1-b284-3f86673a8b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a07dbc06-fbe9-49d8-83a5-a410fa92c0c0', 'volume_name': 'volume-a07dbc06-fbe9-49d8-83a5-a410fa92c0c0', 'volume_size': 2}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:30:26.107667 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e0d8f5-246e-41f3-81cf-217602b687db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:30:26.113173 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e0d8f5-246e-41f3-81cf-217602b687db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:30:26.118253 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b83f51e-3f31-4c2b-8315-e2a7dbe5b21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:30:26.119573 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Volume a07dbc06-fbe9-49d8-83a5-a410fa92c0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a07dbc06-fbe9-49d8-83a5-a410fa92c0c0', 'volume_size': 2}
Apr 16 21:30:26.120360 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] creating volume 'volume-a07dbc06-fbe9-49d8-83a5-a410fa92c0c0' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:30:26.121641 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:26.173989 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-385eb934-c412-45c0-bb61-f131e14073ca req-8208467c-30d2-427e-b4ea-e9bfe1c311f0 tempest-AttachVolumeNegativeTest-1739448039 None] Terminate volume connection completed successfully.
Apr 16 21:30:26.174758 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-385eb934-c412-45c0-bb61-f131e14073ca req-8208467c-30d2-427e-b4ea-e9bfe1c311f0 tempest-AttachVolumeNegativeTest-1739448039 None] Deleting attachment f7802e76-6e28-4669-8d84-ae5084125604. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:30:27.348896 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:30:27.350284 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:30:27.356292 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b83f51e-3f31-4c2b-8315-e2a7dbe5b21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a07dbc06-fbe9-49d8-83a5-a410fa92c0c0', 'volume_size': 2}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:30:27.365555 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4181f47-b0f1-4425-b42e-361475386197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:30:27.475880 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Volume volume-a07dbc06-fbe9-49d8-83a5-a410fa92c0c0 (a07dbc06-fbe9-49d8-83a5-a410fa92c0c0): created successfully
Apr 16 21:30:27.481201 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4181f47-b0f1-4425-b42e-361475386197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:30:27.495796 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Flow 'volume_create_manager' (6320be1d-7432-4fe1-8cc0-8cbf5004fb86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:30:27.669004 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-68e5cfae-3748-4b65-9e1c-72440db9018e tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Created volume successfully.
Apr 16 21:30:28.591343 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:30:28.592750 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:28.725044 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:28.946873 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:30:29.047519 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-36e1b080-ffe3-4c69-9d3d-6ae352c9c76a tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:32.699184 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-36e1b080-ffe3-4c69-9d3d-6ae352c9c76a tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Create snapshot completed successfully
Apr 16 21:30:34.148905 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f9c3d7fe-207a-48eb-b3ca-3773e607c250 tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Lock "b'cinder-cfa43c64-7fc6-4120-ac42-6bbb49cc68c6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.047s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:30:34.150625 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f9c3d7fe-207a-48eb-b3ca-3773e607c250 tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:37.165300 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-99d5b516-faec-4be4-9506-5ce60f2b99ea tempest-AttachVolumeNegativeTest-1739448039 None] Lock "b'cinder-3d395e17-7dd9-4d66-a088-40c6e23eeb95-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:30:37.308838 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99d5b516-faec-4be4-9506-5ce60f2b99ea tempest-AttachVolumeNegativeTest-1739448039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:37.623644 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99d5b516-faec-4be4-9506-5ce60f2b99ea tempest-AttachVolumeNegativeTest-1739448039 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:30:37.624209 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99d5b516-faec-4be4-9506-5ce60f2b99ea tempest-AttachVolumeNegativeTest-1739448039 None] Volume volume-3d395e17-7dd9-4d66-a088-40c6e23eeb95 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:30:37.844459 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99d5b516-faec-4be4-9506-5ce60f2b99ea tempest-AttachVolumeNegativeTest-1739448039 None] deleting rbd volume volume-3d395e17-7dd9-4d66-a088-40c6e23eeb95 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:30:39.020306 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-f9c3d7fe-207a-48eb-b3ca-3773e607c250 tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:30:39.459153 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-f9c3d7fe-207a-48eb-b3ca-3773e607c250 tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Created reservations ['4c48c880-298d-499f-a5ee-36b3c91e87b8', '8adc57c6-53a3-43ac-99c9-7ec05fcf3438', 'bba3a59c-f787-4968-a478-f8a1b076d26e', '24cdc78d-c845-4ace-bc34-30c14088b00d'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:30:39.618292 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f9c3d7fe-207a-48eb-b3ca-3773e607c250 tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Delete snapshot completed successfully.
Apr 16 21:30:39.623658 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f9c3d7fe-207a-48eb-b3ca-3773e607c250 tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Lock "b'cinder-cfa43c64-7fc6-4120-ac42-6bbb49cc68c6-delete_snapshot'" released by "delete_snapshot" :: held 5.475s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:30:40.719167 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-22b85b86-029c-41c0-9309-198f34135e89 tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Lock "b'cinder-a07dbc06-fbe9-49d8-83a5-a410fa92c0c0-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:30:40.865847 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-22b85b86-029c-41c0-9309-198f34135e89 tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:41.112115 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-22b85b86-029c-41c0-9309-198f34135e89 tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:30:41.114816 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-22b85b86-029c-41c0-9309-198f34135e89 tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Volume volume-a07dbc06-fbe9-49d8-83a5-a410fa92c0c0 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:30:41.425857 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-22b85b86-029c-41c0-9309-198f34135e89 tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] deleting rbd volume volume-a07dbc06-fbe9-49d8-83a5-a410fa92c0c0 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:30:47.110702 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-99d5b516-faec-4be4-9506-5ce60f2b99ea tempest-AttachVolumeNegativeTest-1739448039 None] Created reservations ['a399dc4e-fda1-427e-9087-e4bb1fca61b2', '72c9d439-5550-4fb6-9a53-d3da7ac6c18d', 'f4abbe53-f048-414f-b31d-a3c6b6187525', '80cc03e9-1afa-4df9-8b63-fec7876057ed'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:30:47.374763 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99d5b516-faec-4be4-9506-5ce60f2b99ea tempest-AttachVolumeNegativeTest-1739448039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:47.425929 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99d5b516-faec-4be4-9506-5ce60f2b99ea tempest-AttachVolumeNegativeTest-1739448039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:47.559219 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-99d5b516-faec-4be4-9506-5ce60f2b99ea tempest-AttachVolumeNegativeTest-1739448039 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:30:47.564678 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-99d5b516-faec-4be4-9506-5ce60f2b99ea tempest-AttachVolumeNegativeTest-1739448039 None] Deleted volume successfully.
Apr 16 21:30:47.641345 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-99d5b516-faec-4be4-9506-5ce60f2b99ea tempest-AttachVolumeNegativeTest-1739448039 None] Lock "b'cinder-3d395e17-7dd9-4d66-a088-40c6e23eeb95-delete_volume'" released by "delete_volume" :: held 10.478s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:30:48.364908 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c62e7d74-e2f4-4512-b5aa-6816e422a54d tempest-AttachVolumeNegativeTest-1739448039 None] Lock "b'cinder-49d5fd0d-87e4-490a-a0d3-5f24e6948347-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:30:48.507345 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c62e7d74-e2f4-4512-b5aa-6816e422a54d tempest-AttachVolumeNegativeTest-1739448039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:49.008062 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c62e7d74-e2f4-4512-b5aa-6816e422a54d tempest-AttachVolumeNegativeTest-1739448039 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:30:49.008631 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c62e7d74-e2f4-4512-b5aa-6816e422a54d tempest-AttachVolumeNegativeTest-1739448039 None] Volume volume-49d5fd0d-87e4-490a-a0d3-5f24e6948347 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:30:49.333989 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c62e7d74-e2f4-4512-b5aa-6816e422a54d tempest-AttachVolumeNegativeTest-1739448039 None] deleting rbd volume volume-49d5fd0d-87e4-490a-a0d3-5f24e6948347 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:30:50.619152 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-22b85b86-029c-41c0-9309-198f34135e89 tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Created reservations ['94372c0c-3d32-466d-b082-331bb2385bd3', 'd137a823-36f2-4b9f-9c72-c56173291849', '35e48e35-2d26-4c9a-8fc5-db54a5dc9761', '5a608f20-f747-46d0-8b04-b4a6ff252bed'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:30:50.867272 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-22b85b86-029c-41c0-9309-198f34135e89 tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:50.939646 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-22b85b86-029c-41c0-9309-198f34135e89 tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:50.999091 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-22b85b86-029c-41c0-9309-198f34135e89 tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:30:51.006327 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-22b85b86-029c-41c0-9309-198f34135e89 tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Deleted volume successfully.
Apr 16 21:30:51.108983 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-22b85b86-029c-41c0-9309-198f34135e89 tempest-VolumesSnapshotNegativeTestJSON-1441862055 None] Lock "b'cinder-a07dbc06-fbe9-49d8-83a5-a410fa92c0c0-delete_volume'" released by "delete_volume" :: held 10.390s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:30:57.352749 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-c62e7d74-e2f4-4512-b5aa-6816e422a54d tempest-AttachVolumeNegativeTest-1739448039 None] Created reservations ['07f40001-c459-4673-91b2-6e39d40e1e88', 'c2ff778d-e05d-4fe5-b316-3fc50025594e', '7a8e316c-a14a-4254-8fce-f1fa378f6b75', '3352b8c5-5664-4823-849a-b43ff3730b46'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:30:57.566642 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c62e7d74-e2f4-4512-b5aa-6816e422a54d tempest-AttachVolumeNegativeTest-1739448039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:57.651961 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c62e7d74-e2f4-4512-b5aa-6816e422a54d tempest-AttachVolumeNegativeTest-1739448039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:57.745310 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-c62e7d74-e2f4-4512-b5aa-6816e422a54d tempest-AttachVolumeNegativeTest-1739448039 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:30:57.760417 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c62e7d74-e2f4-4512-b5aa-6816e422a54d tempest-AttachVolumeNegativeTest-1739448039 None] Deleted volume successfully.
Apr 16 21:30:57.835175 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c62e7d74-e2f4-4512-b5aa-6816e422a54d tempest-AttachVolumeNegativeTest-1739448039 None] Lock "b'cinder-49d5fd0d-87e4-490a-a0d3-5f24e6948347-delete_volume'" released by "delete_volume" :: held 9.476s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:30:58.776776 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-45c223cf-a4fa-4d0d-9441-300b389fb69a tempest-AttachVolumeNegativeTest-1739448039 None] Lock "b'cinder-a89555a4-c1fe-4512-9779-1ac4ed29f291-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:30:58.972641 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-45c223cf-a4fa-4d0d-9441-300b389fb69a tempest-AttachVolumeNegativeTest-1739448039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:30:59.263495 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-45c223cf-a4fa-4d0d-9441-300b389fb69a tempest-AttachVolumeNegativeTest-1739448039 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:30:59.266458 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-45c223cf-a4fa-4d0d-9441-300b389fb69a tempest-AttachVolumeNegativeTest-1739448039 None] Volume volume-a89555a4-c1fe-4512-9779-1ac4ed29f291 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:30:59.420369 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-45c223cf-a4fa-4d0d-9441-300b389fb69a tempest-AttachVolumeNegativeTest-1739448039 None] deleting rbd volume volume-a89555a4-c1fe-4512-9779-1ac4ed29f291 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:31:07.346413 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-45c223cf-a4fa-4d0d-9441-300b389fb69a tempest-AttachVolumeNegativeTest-1739448039 None] Created reservations ['ba70377f-6686-4824-b93b-41e2fd5553f9', 'bfab6ead-4139-4df7-b050-837b1ae5aab3', '0b58b476-fe79-49c8-bc91-e228ba17eae0', '50468f64-5bf2-4934-b845-983f8e3edd06'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:31:07.620059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-45c223cf-a4fa-4d0d-9441-300b389fb69a tempest-AttachVolumeNegativeTest-1739448039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:31:07.796454 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-45c223cf-a4fa-4d0d-9441-300b389fb69a tempest-AttachVolumeNegativeTest-1739448039 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:31:07.879181 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-45c223cf-a4fa-4d0d-9441-300b389fb69a tempest-AttachVolumeNegativeTest-1739448039 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:31:07.897507 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-45c223cf-a4fa-4d0d-9441-300b389fb69a tempest-AttachVolumeNegativeTest-1739448039 None] Deleted volume successfully.
Apr 16 21:31:08.002254 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-45c223cf-a4fa-4d0d-9441-300b389fb69a tempest-AttachVolumeNegativeTest-1739448039 None] Lock "b'cinder-a89555a4-c1fe-4512-9779-1ac4ed29f291-delete_volume'" released by "delete_volume" :: held 9.226s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:31:24.952653 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:31:24.991804 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Flow 'volume_create_manager' (87f8ad0e-ef03-42a7-9baa-d2d7f319511b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:31:25.018511 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34295a6a-ea48-440c-8bf3-2baa16efa530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:31:25.043683 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34295a6a-ea48-440c-8bf3-2baa16efa530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2002100770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5221184f-a588-4b9c-a8d4-80bc2be5e2ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8bb721bf84fa46b784e107c27ac8b077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:31:25Z,use_quota=True,user_id='1a24951f76e84f13af0a16b892f2db65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:31:25.051451 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c8661d-aaa8-44f9-9a96-adcf0c86fdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:31:25.057333 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c8661d-aaa8-44f9-9a96-adcf0c86fdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:31:25.065187 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8cfe4f-648c-4812-8a98-31b5d21b94d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:31:25.072663 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8cfe4f-648c-4812-8a98-31b5d21b94d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5221184f-a588-4b9c-a8d4-80bc2be5e2ed', 'volume_name': 'volume-5221184f-a588-4b9c-a8d4-80bc2be5e2ed', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:31:25.080159 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ce2921-4a68-4b3a-a6ff-c44a56589da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:31:25.084764 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ce2921-4a68-4b3a-a6ff-c44a56589da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:31:25.096478 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4a23c7-40d3-47d6-b41d-18975023bc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:31:25.096478 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Volume 5221184f-a588-4b9c-a8d4-80bc2be5e2ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5221184f-a588-4b9c-a8d4-80bc2be5e2ed', 'volume_size': 1}
Apr 16 21:31:25.096478 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] creating volume 'volume-5221184f-a588-4b9c-a8d4-80bc2be5e2ed' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:31:25.096478 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:31:25.705501 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:31:25.706187 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:31:25.710516 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4a23c7-40d3-47d6-b41d-18975023bc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5221184f-a588-4b9c-a8d4-80bc2be5e2ed', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:31:25.736620 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a23aa92f-08e9-4258-a547-0863d8eacf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:31:25.836084 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Volume volume-5221184f-a588-4b9c-a8d4-80bc2be5e2ed (5221184f-a588-4b9c-a8d4-80bc2be5e2ed): created successfully
Apr 16 21:31:25.840718 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a23aa92f-08e9-4258-a547-0863d8eacf63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:31:25.846231 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Flow 'volume_create_manager' (87f8ad0e-ef03-42a7-9baa-d2d7f319511b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:31:25.944551 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-48ca9d49-e090-41d8-8f89-a1c45558fca5 req-8572421f-40be-4051-bf63-58db5eaf5578 tempest-VolumesGetTestJSON-104499336 None] Created volume successfully.
Apr 16 21:31:27.314153 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-1aefff68-0154-4bac-b03e-08b682426882 req-b77b5278-32a3-4c84-b8b9-32a003c616df tempest-VolumesGetTestJSON-104499336 None] Lock "b'cinder-5221184f-a588-4b9c-a8d4-80bc2be5e2ed-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:31:27.445475 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-1aefff68-0154-4bac-b03e-08b682426882 req-b77b5278-32a3-4c84-b8b9-32a003c616df tempest-VolumesGetTestJSON-104499336 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:31:27.677775 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-1aefff68-0154-4bac-b03e-08b682426882 req-b77b5278-32a3-4c84-b8b9-32a003c616df tempest-VolumesGetTestJSON-104499336 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:31:27.678453 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-1aefff68-0154-4bac-b03e-08b682426882 req-b77b5278-32a3-4c84-b8b9-32a003c616df tempest-VolumesGetTestJSON-104499336 None] Volume volume-5221184f-a588-4b9c-a8d4-80bc2be5e2ed is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:31:27.796584 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-1aefff68-0154-4bac-b03e-08b682426882 req-b77b5278-32a3-4c84-b8b9-32a003c616df tempest-VolumesGetTestJSON-104499336 None] deleting rbd volume volume-5221184f-a588-4b9c-a8d4-80bc2be5e2ed {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:31:28.594273 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:31:28.595955 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:31:28.663725 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:31:28.721023 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:31:31.660773 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-1aefff68-0154-4bac-b03e-08b682426882 req-b77b5278-32a3-4c84-b8b9-32a003c616df tempest-VolumesGetTestJSON-104499336 None] Created reservations ['6c98131c-0c8d-4e89-8c7d-f26fe4922f4a', '40ef308e-caea-4ed2-9a4c-b4f84e1d7c60', 'dd9c428e-994a-49f0-bc1d-f50031d8dc2f', '4b22d865-10db-47a0-b014-08ff3d6f9262'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:31:31.870132 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-1aefff68-0154-4bac-b03e-08b682426882 req-b77b5278-32a3-4c84-b8b9-32a003c616df tempest-VolumesGetTestJSON-104499336 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:31:31.949199 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-1aefff68-0154-4bac-b03e-08b682426882 req-b77b5278-32a3-4c84-b8b9-32a003c616df tempest-VolumesGetTestJSON-104499336 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:31:32.015632 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-1aefff68-0154-4bac-b03e-08b682426882 req-b77b5278-32a3-4c84-b8b9-32a003c616df tempest-VolumesGetTestJSON-104499336 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:31:32.020449 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-1aefff68-0154-4bac-b03e-08b682426882 req-b77b5278-32a3-4c84-b8b9-32a003c616df tempest-VolumesGetTestJSON-104499336 None] Deleted volume successfully.
Apr 16 21:31:32.147761 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-1aefff68-0154-4bac-b03e-08b682426882 req-b77b5278-32a3-4c84-b8b9-32a003c616df tempest-VolumesGetTestJSON-104499336 None] Lock "b'cinder-5221184f-a588-4b9c-a8d4-80bc2be5e2ed-delete_volume'" released by "delete_volume" :: held 4.837s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:31:32.281762 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-0a92f85b-e095-4ae2-8c7b-9b6b0c079982 req-4014ab6d-3770-4047-b198-ef54f704ea4d tempest-TaggedBootDevicesTest_v242-1122505264 None] Terminate volume connection completed successfully.
Apr 16 21:31:32.282440 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-0a92f85b-e095-4ae2-8c7b-9b6b0c079982 req-4014ab6d-3770-4047-b198-ef54f704ea4d tempest-TaggedBootDevicesTest_v242-1122505264 None] Deleting attachment 7320c8b0-1ef5-42ca-8412-3afe507a110b. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:31:32.568439 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-0a92f85b-e095-4ae2-8c7b-9b6b0c079982 req-6362e758-3d5d-4b35-b239-4a853f3aba3a tempest-TaggedBootDevicesTest_v242-1122505264 None] Terminate volume connection completed successfully.
Apr 16 21:31:32.572199 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-0a92f85b-e095-4ae2-8c7b-9b6b0c079982 req-6362e758-3d5d-4b35-b239-4a853f3aba3a tempest-TaggedBootDevicesTest_v242-1122505264 None] Deleting attachment d5b52ac2-e5e5-43f2-951b-db37d4267d57. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:31:32.835273 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-0a92f85b-e095-4ae2-8c7b-9b6b0c079982 req-34d6bd1f-eb5e-488e-91dc-a4d716877615 tempest-TaggedBootDevicesTest_v242-1122505264 None] Terminate volume connection completed successfully.
Apr 16 21:31:32.841831 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-0a92f85b-e095-4ae2-8c7b-9b6b0c079982 req-34d6bd1f-eb5e-488e-91dc-a4d716877615 tempest-TaggedBootDevicesTest_v242-1122505264 None] Deleting attachment 9b79335b-d0df-43cf-8de4-2f4ce53c3f8f. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:31:43.616096 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8ef43498-6dbd-4dc1-ad10-071a275581c0 tempest-TaggedBootDevicesTest_v242-1122505264 None] Lock "b'cinder-4bf759bc-60a0-4375-9c3a-38f91859fd27-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:31:43.724801 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8ef43498-6dbd-4dc1-ad10-071a275581c0 tempest-TaggedBootDevicesTest_v242-1122505264 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:31:43.923224 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8ef43498-6dbd-4dc1-ad10-071a275581c0 tempest-TaggedBootDevicesTest_v242-1122505264 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:31:43.924701 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8ef43498-6dbd-4dc1-ad10-071a275581c0 tempest-TaggedBootDevicesTest_v242-1122505264 None] Volume volume-4bf759bc-60a0-4375-9c3a-38f91859fd27 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:31:44.013861 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8ef43498-6dbd-4dc1-ad10-071a275581c0 tempest-TaggedBootDevicesTest_v242-1122505264 None] deleting rbd volume volume-4bf759bc-60a0-4375-9c3a-38f91859fd27 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:31:48.145664 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-8ef43498-6dbd-4dc1-ad10-071a275581c0 tempest-TaggedBootDevicesTest_v242-1122505264 None] Created reservations ['de169f5d-1ada-4e58-a403-7ccd5792f88b', '7d7062a3-7c17-4b25-b34f-9bc4cb5890e4', '2d85463b-22c7-475d-8a07-fd22db066c1a', 'b68e3115-50b6-4410-a12d-ba402360b81b'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:31:48.375227 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8ef43498-6dbd-4dc1-ad10-071a275581c0 tempest-TaggedBootDevicesTest_v242-1122505264 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:31:48.454577 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8ef43498-6dbd-4dc1-ad10-071a275581c0 tempest-TaggedBootDevicesTest_v242-1122505264 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:31:48.547689 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8ef43498-6dbd-4dc1-ad10-071a275581c0 tempest-TaggedBootDevicesTest_v242-1122505264 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:31:48.560684 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8ef43498-6dbd-4dc1-ad10-071a275581c0 tempest-TaggedBootDevicesTest_v242-1122505264 None] Deleted volume successfully.
Apr 16 21:31:48.638071 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8ef43498-6dbd-4dc1-ad10-071a275581c0 tempest-TaggedBootDevicesTest_v242-1122505264 None] Lock "b'cinder-4bf759bc-60a0-4375-9c3a-38f91859fd27-delete_volume'" released by "delete_volume" :: held 5.021s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:31:49.379466 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f7149690-42f5-4d31-a152-7802fdf8454c tempest-TaggedBootDevicesTest_v242-1122505264 None] Lock "b'cinder-a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:31:49.555790 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f7149690-42f5-4d31-a152-7802fdf8454c tempest-TaggedBootDevicesTest_v242-1122505264 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:31:49.779295 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f7149690-42f5-4d31-a152-7802fdf8454c tempest-TaggedBootDevicesTest_v242-1122505264 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:31:49.779868 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f7149690-42f5-4d31-a152-7802fdf8454c tempest-TaggedBootDevicesTest_v242-1122505264 None] Volume volume-a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:31:49.945939 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f7149690-42f5-4d31-a152-7802fdf8454c tempest-TaggedBootDevicesTest_v242-1122505264 None] deleting rbd volume volume-a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:31:53.694136 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-f7149690-42f5-4d31-a152-7802fdf8454c tempest-TaggedBootDevicesTest_v242-1122505264 None] Created reservations ['8d0f0eda-4e2e-4267-b673-5e1ce4b056ba', '40d46a37-775a-4c85-b769-41427b334cd1', '13fa690b-136f-475b-94b6-301fbe8604d1', '1b201324-3794-4302-9e49-969ef97b0a76'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:31:53.899606 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f7149690-42f5-4d31-a152-7802fdf8454c tempest-TaggedBootDevicesTest_v242-1122505264 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:31:53.973251 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f7149690-42f5-4d31-a152-7802fdf8454c tempest-TaggedBootDevicesTest_v242-1122505264 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:31:54.042849 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-f7149690-42f5-4d31-a152-7802fdf8454c tempest-TaggedBootDevicesTest_v242-1122505264 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:31:54.048732 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f7149690-42f5-4d31-a152-7802fdf8454c tempest-TaggedBootDevicesTest_v242-1122505264 None] Deleted volume successfully.
Apr 16 21:31:54.155057 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f7149690-42f5-4d31-a152-7802fdf8454c tempest-TaggedBootDevicesTest_v242-1122505264 None] Lock "b'cinder-a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c-delete_volume'" released by "delete_volume" :: held 4.776s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:31:55.103859 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b87373e8-359c-4b14-8ae5-6a393eeb2110 tempest-TaggedBootDevicesTest_v242-1122505264 None] Lock "b'cinder-0762402c-a0d6-4894-bf49-142a2b216d88-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:31:55.242258 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b87373e8-359c-4b14-8ae5-6a393eeb2110 tempest-TaggedBootDevicesTest_v242-1122505264 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:31:55.457387 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b87373e8-359c-4b14-8ae5-6a393eeb2110 tempest-TaggedBootDevicesTest_v242-1122505264 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:31:55.620942 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b87373e8-359c-4b14-8ae5-6a393eeb2110 tempest-TaggedBootDevicesTest_v242-1122505264 None] deleting rbd volume volume-0762402c-a0d6-4894-bf49-142a2b216d88 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:32:00.025791 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b87373e8-359c-4b14-8ae5-6a393eeb2110 tempest-TaggedBootDevicesTest_v242-1122505264 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:32:00.148898 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b87373e8-359c-4b14-8ae5-6a393eeb2110 tempest-TaggedBootDevicesTest_v242-1122505264 None] deleting parent snapshot volume-0762402c-a0d6-4894-bf49-142a2b216d88.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:32:02.647686 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-b87373e8-359c-4b14-8ae5-6a393eeb2110 tempest-TaggedBootDevicesTest_v242-1122505264 None] Created reservations ['abf935cc-7d32-47bb-a4ea-091fec13d1be', '43e8905a-c0f1-4c2a-b8f1-a21b0544ae38', 'ffda0f87-50f2-4842-a797-61f71d7123cb', '7124b9ba-3dc8-4c57-ac0c-e6ec290123d1'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:32:02.900000 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b87373e8-359c-4b14-8ae5-6a393eeb2110 tempest-TaggedBootDevicesTest_v242-1122505264 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:32:02.994893 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b87373e8-359c-4b14-8ae5-6a393eeb2110 tempest-TaggedBootDevicesTest_v242-1122505264 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:32:03.058861 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-b87373e8-359c-4b14-8ae5-6a393eeb2110 tempest-TaggedBootDevicesTest_v242-1122505264 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:32:03.064798 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b87373e8-359c-4b14-8ae5-6a393eeb2110 tempest-TaggedBootDevicesTest_v242-1122505264 None] Deleted volume successfully.
Apr 16 21:32:03.156487 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b87373e8-359c-4b14-8ae5-6a393eeb2110 tempest-TaggedBootDevicesTest_v242-1122505264 None] Lock "b'cinder-0762402c-a0d6-4894-bf49-142a2b216d88-delete_volume'" released by "delete_volume" :: held 8.052s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:32:14.494563 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:32:14.516706 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Flow 'volume_create_manager' (8ed632e6-f837-4cfe-9625-3e73b64303ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:32:14.525289 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2c7504-23bd-42cd-97db-b3bc6c7c4c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:32:14.542753 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2c7504-23bd-42cd-97db-b3bc6c7c4c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1012473197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=53ad134b-66f9-4d7f-b696-56f6d63b72e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3a8f4590014b8d9738bd3739f08c0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:32:14Z,use_quota=True,user_id='e007558161974720bb11a4e7588af0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:32:14.551444 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f822604-2ed8-4621-8454-75d392259624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:32:14.556116 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f822604-2ed8-4621-8454-75d392259624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:32:14.562253 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a006f928-4fb8-4c34-afbe-164b93d0e675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:32:14.567219 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a006f928-4fb8-4c34-afbe-164b93d0e675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53ad134b-66f9-4d7f-b696-56f6d63b72e9', 'volume_name': 'volume-53ad134b-66f9-4d7f-b696-56f6d63b72e9', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:32:14.573231 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0beeb5-e69e-4648-bfe3-3771c74a9728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:32:14.577458 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0beeb5-e69e-4648-bfe3-3771c74a9728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:32:14.584608 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f518dd-8b1b-4790-bf18-c373bb6491b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:32:14.586015 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Volume 53ad134b-66f9-4d7f-b696-56f6d63b72e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53ad134b-66f9-4d7f-b696-56f6d63b72e9', 'volume_size': 1}
Apr 16 21:32:14.586606 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] creating volume 'volume-53ad134b-66f9-4d7f-b696-56f6d63b72e9' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:32:14.588129 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:32:15.195330 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:32:15.196201 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:32:15.200360 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f518dd-8b1b-4790-bf18-c373bb6491b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53ad134b-66f9-4d7f-b696-56f6d63b72e9', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:32:15.205633 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99ded62-1446-4627-9fb1-a4a516e41777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:32:15.333202 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Volume volume-53ad134b-66f9-4d7f-b696-56f6d63b72e9 (53ad134b-66f9-4d7f-b696-56f6d63b72e9): created successfully
Apr 16 21:32:15.341168 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99ded62-1446-4627-9fb1-a4a516e41777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:32:15.355233 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Flow 'volume_create_manager' (8ed632e6-f837-4cfe-9625-3e73b64303ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:32:15.527313 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c5262cf5-f7f9-4cdb-aee8-3e162413703a tempest-AttachVolumeShelveTestJSON-1483033820 None] Created volume successfully.
Apr 16 21:32:28.599265 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:32:28.599946 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:32:28.666703 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:32:28.767970 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:33:11.614975 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 req-2d97ca86-4d49-4bbf-bc9e-edaedd8b9ea2 tempest-AttachVolumeShelveTestJSON-1483033820 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:33:12.614335 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 req-2d97ca86-4d49-4bbf-bc9e-edaedd8b9ea2 tempest-AttachVolumeShelveTestJSON-1483033820 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.999s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:33:12.615170 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 req-2d97ca86-4d49-4bbf-bc9e-edaedd8b9ea2 tempest-AttachVolumeShelveTestJSON-1483033820 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-53ad134b-66f9-4d7f-b696-56f6d63b72e9', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '53ad134b-66f9-4d7f-b696-56f6d63b72e9', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:33:12.768361 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 req-2d97ca86-4d49-4bbf-bc9e-edaedd8b9ea2 tempest-AttachVolumeShelveTestJSON-1483033820 None] Connection info returned from driver {'name': 'volumes/volume-53ad134b-66f9-4d7f-b696-56f6d63b72e9', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '53ad134b-66f9-4d7f-b696-56f6d63b72e9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0907f9c1-a06c-4f4d-8c78-ba001d7981b5'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:33:12.920598 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 req-2d97ca86-4d49-4bbf-bc9e-edaedd8b9ea2 tempest-AttachVolumeShelveTestJSON-1483033820 None] attachment_update completed successfully.
Apr 16 21:33:28.071969 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:33:28.129908 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Flow 'volume_create_manager' (53b59d40-c36f-4f6d-9136-facd0ee11d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:33:28.148607 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8fd5f1-9402-40ef-9716-e8339d8a9a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:33:28.192059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8fd5f1-9402-40ef-9716-e8339d8a9a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2075992388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=170e1538-909b-47f7-b0ad-70cb85a328fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e18c5eb6e744c5fa1208eaca5c4702c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:33:28Z,use_quota=True,user_id='fe7deffb001d4d909400af2a9a769788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(859c4e13-e934-428f-a303-c1228fe8358f),volume_type_id=859c4e13-e934-428f-a303-c1228fe8358f)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:33:28.211768 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3947ff-67d4-41f9-9bd9-24c4d7dc1d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:33:28.223631 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3947ff-67d4-41f9-9bd9-24c4d7dc1d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:33:28.237503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a49a76b-aaf5-42c6-b526-b27c34f1bc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:33:28.249268 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a49a76b-aaf5-42c6-b526-b27c34f1bc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '170e1538-909b-47f7-b0ad-70cb85a328fd', 'volume_name': 'volume-170e1538-909b-47f7-b0ad-70cb85a328fd', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:33:28.266260 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fe3d32-2619-4a7d-87b2-d5d58942769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:33:28.281570 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fe3d32-2619-4a7d-87b2-d5d58942769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:33:28.297653 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5445fb-c5da-4a89-80c5-7960bee2a59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:33:28.299847 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Volume 170e1538-909b-47f7-b0ad-70cb85a328fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-170e1538-909b-47f7-b0ad-70cb85a328fd', 'volume_size': 1}
Apr 16 21:33:28.300487 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] creating volume 'volume-170e1538-909b-47f7-b0ad-70cb85a328fd' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:33:28.303616 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:33:28.606104 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:33:28.607582 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:33:28.716370 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:33:28.815853 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:33:28.933838 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:33:28.935115 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:33:28.939504 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5445fb-c5da-4a89-80c5-7960bee2a59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-170e1538-909b-47f7-b0ad-70cb85a328fd', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:33:28.955680 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (785690ea-d0ac-413b-a38e-c6b89f1ca520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:33:29.384559 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Volume volume-170e1538-909b-47f7-b0ad-70cb85a328fd (170e1538-909b-47f7-b0ad-70cb85a328fd): created successfully
Apr 16 21:33:29.394254 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (785690ea-d0ac-413b-a38e-c6b89f1ca520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:33:29.396397 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Flow 'volume_create_manager' (53b59d40-c36f-4f6d-9136-facd0ee11d80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:33:29.498641 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a2e091e4-2178-42e7-9890-04e1ec9a1c13 tempest-VolumeTypesAccessTest-311973181 None] Created volume successfully.
Apr 16 21:33:31.948494 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ef5b289d-60fe-46dd-92cd-c5c2e5604e0c tempest-VolumeTypesAccessTest-311973181 None] Lock "b'cinder-170e1538-909b-47f7-b0ad-70cb85a328fd-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:33:32.078373 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ef5b289d-60fe-46dd-92cd-c5c2e5604e0c tempest-VolumeTypesAccessTest-311973181 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:33:32.314448 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ef5b289d-60fe-46dd-92cd-c5c2e5604e0c tempest-VolumeTypesAccessTest-311973181 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:33:32.315283 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ef5b289d-60fe-46dd-92cd-c5c2e5604e0c tempest-VolumeTypesAccessTest-311973181 None] Volume volume-170e1538-909b-47f7-b0ad-70cb85a328fd is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:33:32.453507 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ef5b289d-60fe-46dd-92cd-c5c2e5604e0c tempest-VolumeTypesAccessTest-311973181 None] deleting rbd volume volume-170e1538-909b-47f7-b0ad-70cb85a328fd {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:33:35.939955 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-ef5b289d-60fe-46dd-92cd-c5c2e5604e0c tempest-VolumeTypesAccessTest-311973181 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-694544638 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-694544638, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:33:35.941471 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-ef5b289d-60fe-46dd-92cd-c5c2e5604e0c tempest-VolumeTypesAccessTest-311973181 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-694544638 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-694544638, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:33:36.029959 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-ef5b289d-60fe-46dd-92cd-c5c2e5604e0c tempest-VolumeTypesAccessTest-311973181 None] Created reservations ['e5a7fac9-8a53-4c3f-ab26-2bd9027c51c3', 'ec77012f-1451-4995-8181-e1a44de7f468', 'bce48b80-71dc-4fbc-a967-6929d19855cf', 'fb72f961-5f91-41b7-a827-16993cbda57a'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:33:36.305190 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ef5b289d-60fe-46dd-92cd-c5c2e5604e0c tempest-VolumeTypesAccessTest-311973181 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:33:36.364498 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ef5b289d-60fe-46dd-92cd-c5c2e5604e0c tempest-VolumeTypesAccessTest-311973181 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:33:36.465960 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-ef5b289d-60fe-46dd-92cd-c5c2e5604e0c tempest-VolumeTypesAccessTest-311973181 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:33:36.471223 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ef5b289d-60fe-46dd-92cd-c5c2e5604e0c tempest-VolumeTypesAccessTest-311973181 None] Deleted volume successfully.
Apr 16 21:33:36.545042 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ef5b289d-60fe-46dd-92cd-c5c2e5604e0c tempest-VolumeTypesAccessTest-311973181 None] Lock "b'cinder-170e1538-909b-47f7-b0ad-70cb85a328fd-delete_volume'" released by "delete_volume" :: held 4.597s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:33:45.826509 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:33:45.845398 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Flow 'volume_create_manager' (a3b318c3-f2cc-470a-895f-e002e936a25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:33:45.852883 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62587c4-1eb9-4b06-b70e-944ff2c67901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:33:45.876045 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62587c4-1eb9-4b06-b70e-944ff2c67901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1854765618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a6a93ad1-55a2-43b2-a0dc-9512f855adf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f5674dc29c46d99ff0755fe69fa69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:33:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:33:46Z,use_quota=True,user_id='04de2c0fb811414ea6639a0e8a215b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:33:45.883196 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc1019e-3851-45b2-8f40-9e4f8e9a381d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:33:45.889268 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc1019e-3851-45b2-8f40-9e4f8e9a381d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:33:45.911225 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8a2885-2fa0-429e-87da-2c35d17407e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:33:45.921153 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8a2885-2fa0-429e-87da-2c35d17407e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a93ad1-55a2-43b2-a0dc-9512f855adf9', 'volume_name': 'volume-a6a93ad1-55a2-43b2-a0dc-9512f855adf9', 'volume_size': 2}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:33:45.939076 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e563fbac-36eb-40fd-8d8b-88b5193e1888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:33:45.950796 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e563fbac-36eb-40fd-8d8b-88b5193e1888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:33:45.959436 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098cc706-abad-4f47-a82d-b4c07b16b4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:33:45.960620 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Volume a6a93ad1-55a2-43b2-a0dc-9512f855adf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a93ad1-55a2-43b2-a0dc-9512f855adf9', 'volume_size': 2}
Apr 16 21:33:45.961360 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] creating volume 'volume-a6a93ad1-55a2-43b2-a0dc-9512f855adf9' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:33:45.962344 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:33:46.733245 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:33:46.733245 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:33:46.733245 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098cc706-abad-4f47-a82d-b4c07b16b4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a93ad1-55a2-43b2-a0dc-9512f855adf9', 'volume_size': 2}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:33:46.733245 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f772d51-02d2-4b4a-8adc-9fa5b1739da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:33:46.818276 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Volume volume-a6a93ad1-55a2-43b2-a0dc-9512f855adf9 (a6a93ad1-55a2-43b2-a0dc-9512f855adf9): created successfully
Apr 16 21:33:46.823440 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f772d51-02d2-4b4a-8adc-9fa5b1739da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:33:46.830610 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Flow 'volume_create_manager' (a3b318c3-f2cc-470a-895f-e002e936a25d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:33:46.984217 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a2aa71ea-ac55-4d14-a853-0e71e3790288 tempest-VolumesCloneNegativeTest-1055604328 None] Created volume successfully.
Apr 16 21:33:48.067935 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9bca891f-d060-4676-b3c9-7beabd4c0ac1 tempest-VolumesCloneNegativeTest-1055604328 None] Lock "b'cinder-a6a93ad1-55a2-43b2-a0dc-9512f855adf9-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:33:48.204591 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9bca891f-d060-4676-b3c9-7beabd4c0ac1 tempest-VolumesCloneNegativeTest-1055604328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:33:48.424149 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9bca891f-d060-4676-b3c9-7beabd4c0ac1 tempest-VolumesCloneNegativeTest-1055604328 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:33:48.424737 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9bca891f-d060-4676-b3c9-7beabd4c0ac1 tempest-VolumesCloneNegativeTest-1055604328 None] Volume volume-a6a93ad1-55a2-43b2-a0dc-9512f855adf9 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:33:48.533251 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9bca891f-d060-4676-b3c9-7beabd4c0ac1 tempest-VolumesCloneNegativeTest-1055604328 None] deleting rbd volume volume-a6a93ad1-55a2-43b2-a0dc-9512f855adf9 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:33:52.180076 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-9bca891f-d060-4676-b3c9-7beabd4c0ac1 tempest-VolumesCloneNegativeTest-1055604328 None] Created reservations ['5cf5b9b2-a8cb-470b-9cb6-5d9d9c32a6ec', '9cde4b82-fec0-44c5-b003-76bda0c4f027', 'e7227435-faf0-49a2-8a9a-00404984c842', '34841f0a-3334-4fb4-8707-33cb50d61a91'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:33:52.352148 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9bca891f-d060-4676-b3c9-7beabd4c0ac1 tempest-VolumesCloneNegativeTest-1055604328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:33:52.436258 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9bca891f-d060-4676-b3c9-7beabd4c0ac1 tempest-VolumesCloneNegativeTest-1055604328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:33:52.503067 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-9bca891f-d060-4676-b3c9-7beabd4c0ac1 tempest-VolumesCloneNegativeTest-1055604328 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:33:52.508379 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9bca891f-d060-4676-b3c9-7beabd4c0ac1 tempest-VolumesCloneNegativeTest-1055604328 None] Deleted volume successfully.
Apr 16 21:33:52.569229 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9bca891f-d060-4676-b3c9-7beabd4c0ac1 tempest-VolumesCloneNegativeTest-1055604328 None] Lock "b'cinder-a6a93ad1-55a2-43b2-a0dc-9512f855adf9-delete_volume'" released by "delete_volume" :: held 4.503s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:34:28.605689 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:34:28.606530 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:34:28.681585 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:34:28.751142 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:34:53.961821 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-b76f08e8-76d6-44b9-b6dd-072b9a62b707 req-ff6edca4-fc73-47ff-ab48-027f2ee448c0 tempest-AttachVolumeShelveTestJSON-1483033820 None] Terminate volume connection completed successfully.
Apr 16 21:34:53.962589 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-b76f08e8-76d6-44b9-b6dd-072b9a62b707 req-ff6edca4-fc73-47ff-ab48-027f2ee448c0 tempest-AttachVolumeShelveTestJSON-1483033820 None] Deleting attachment 0907f9c1-a06c-4f4d-8c78-ba001d7981b5. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:34:54.093197 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8b6a7fba-2468-4d1f-a9df-eea89fba8ec5 tempest-GroupSnapshotsV319Test-374512164 None] Group tempest-GroupSnapshotsV319Test-Group-519419348: creating
Apr 16 21:34:54.196564 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8b6a7fba-2468-4d1f-a9df-eea89fba8ec5 tempest-GroupSnapshotsV319Test-374512164 None] Group tempest-GroupSnapshotsV319Test-Group-519419348: created successfully
Apr 16 21:34:54.211282 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8b6a7fba-2468-4d1f-a9df-eea89fba8ec5 tempest-GroupSnapshotsV319Test-374512164 None] Create group completed successfully.
Apr 16 21:34:56.300882 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:34:56.325503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Flow 'volume_create_manager' (e1430593-caff-4ee0-a886-647a4a2403aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:34:56.344361 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd1ef87-30a3-4392-a52b-43513db667be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:34:56.377967 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd1ef87-30a3-4392-a52b-43513db667be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-2024863041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=311d5ff6-9e34-4582-88f4-3b31daaf05b1,host='ncdv-master-1@ceph#ceph',id=3ada1481-703f-4f93-90de-5ef5b60a3223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13d5a881166456c8b1682455323c927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:34:56Z,use_quota=True,user_id='ff053f3bb2c94262860e8a9e48954d20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7dda84f0-45a5-4016-935b-ab28003842bb),volume_type_id=7dda84f0-45a5-4016-935b-ab28003842bb)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:34:56.397762 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1660a8a8-a5fa-44a7-8b96-5368a2701171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:34:56.405123 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1660a8a8-a5fa-44a7-8b96-5368a2701171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:34:56.441171 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39af6852-413c-40b8-9f68-a0612a23b93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:34:56.449332 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39af6852-413c-40b8-9f68-a0612a23b93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ada1481-703f-4f93-90de-5ef5b60a3223', 'volume_name': 'volume-3ada1481-703f-4f93-90de-5ef5b60a3223', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:34:56.468679 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bbf71d-3be0-4a1e-ba40-24e8479bfb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:34:56.474347 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bbf71d-3be0-4a1e-ba40-24e8479bfb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:34:56.481324 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd51d659-05c1-42a1-8fc5-fa068d6860db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:34:56.482881 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Volume 3ada1481-703f-4f93-90de-5ef5b60a3223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ada1481-703f-4f93-90de-5ef5b60a3223', 'volume_size': 1}
Apr 16 21:34:56.483468 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] creating volume 'volume-3ada1481-703f-4f93-90de-5ef5b60a3223' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:34:56.484867 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:34:57.159366 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:34:57.170561 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:34:57.170561 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd51d659-05c1-42a1-8fc5-fa068d6860db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ada1481-703f-4f93-90de-5ef5b60a3223', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:34:57.173582 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d5eb92-3163-434a-ada6-24a1e1bc3e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:34:57.247053 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Volume volume-3ada1481-703f-4f93-90de-5ef5b60a3223 (3ada1481-703f-4f93-90de-5ef5b60a3223): created successfully
Apr 16 21:34:57.250820 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d5eb92-3163-434a-ada6-24a1e1bc3e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:34:57.262652 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Flow 'volume_create_manager' (e1430593-caff-4ee0-a886-647a4a2403aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:34:57.327779 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1a1cbb24-8ee7-4866-b87b-da6d95bfca5f tempest-GroupSnapshotsV319Test-374512164 None] Created volume successfully.
Apr 16 21:34:58.995853 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3ffa6739-ac04-4faa-88d7-5786637b8a9c tempest-GroupSnapshotsV319Test-374512164 None] GroupSnapshot 8674623a-21fd-491e-ab3a-cac23d13ebf2: creating.
Apr 16 21:34:59.103863 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3ffa6739-ac04-4faa-88d7-5786637b8a9c tempest-GroupSnapshotsV319Test-374512164 None] Group snapshot 8674623a-21fd-491e-ab3a-cac23d13ebf2: creating. {{(pid=130674) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}}
Apr 16 21:34:59.140937 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3ffa6739-ac04-4faa-88d7-5786637b8a9c tempest-GroupSnapshotsV319Test-374512164 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:01.413866 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3ffa6739-ac04-4faa-88d7-5786637b8a9c tempest-GroupSnapshotsV319Test-374512164 None] group_snapshot 8674623a-21fd-491e-ab3a-cac23d13ebf2: created successfully
Apr 16 21:35:03.099220 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cb226850-b9a8-4d63-a8f2-5b0e5af6c39a tempest-GroupSnapshotsV319Test-374512164 None] group_snapshot 8674623a-21fd-491e-ab3a-cac23d13ebf2: deleting
Apr 16 21:35:03.126374 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cb226850-b9a8-4d63-a8f2-5b0e5af6c39a tempest-GroupSnapshotsV319Test-374512164 None] group_snapshot 8674623a-21fd-491e-ab3a-cac23d13ebf2: deleting {{(pid=130674) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}}
Apr 16 21:35:03.151468 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cb226850-b9a8-4d63-a8f2-5b0e5af6c39a tempest-GroupSnapshotsV319Test-374512164 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:05.568544 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-cb226850-b9a8-4d63-a8f2-5b0e5af6c39a tempest-GroupSnapshotsV319Test-374512164 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-578187481 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-578187481, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:35:05.570086 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-cb226850-b9a8-4d63-a8f2-5b0e5af6c39a tempest-GroupSnapshotsV319Test-374512164 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-578187481 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-578187481, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:35:05.692931 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-cb226850-b9a8-4d63-a8f2-5b0e5af6c39a tempest-GroupSnapshotsV319Test-374512164 None] Created reservations ['6455f82b-3606-4207-bfcb-03e29c1889fd', '13712ab3-5249-4d84-8436-b1b3d20d741d', 'ab6d2a2e-1bd2-447f-b236-c70e3a10ad48', '7b08b6c7-3115-487f-ae31-7e577e35ec45'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:35:05.967543 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cb226850-b9a8-4d63-a8f2-5b0e5af6c39a tempest-GroupSnapshotsV319Test-374512164 None] group_snapshot 8674623a-21fd-491e-ab3a-cac23d13ebf2: deleted successfully
Apr 16 21:35:07.077586 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf20872b-9dd4-4784-a53a-0dd8acc06a0c tempest-GroupSnapshotsV319Test-374512164 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:07.315186 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf20872b-9dd4-4784-a53a-0dd8acc06a0c tempest-GroupSnapshotsV319Test-374512164 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:35:07.315778 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf20872b-9dd4-4784-a53a-0dd8acc06a0c tempest-GroupSnapshotsV319Test-374512164 None] Volume volume-3ada1481-703f-4f93-90de-5ef5b60a3223 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:35:07.470090 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf20872b-9dd4-4784-a53a-0dd8acc06a0c tempest-GroupSnapshotsV319Test-374512164 None] deleting rbd volume volume-3ada1481-703f-4f93-90de-5ef5b60a3223 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:35:11.142262 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-cf20872b-9dd4-4784-a53a-0dd8acc06a0c tempest-GroupSnapshotsV319Test-374512164 None] Created reservations ['456ad8e9-0eb3-4d3e-9967-5a3efdbed36d'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:35:11.156521 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-cf20872b-9dd4-4784-a53a-0dd8acc06a0c tempest-GroupSnapshotsV319Test-374512164 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-578187481 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-578187481, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:35:11.304772 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-cf20872b-9dd4-4784-a53a-0dd8acc06a0c tempest-GroupSnapshotsV319Test-374512164 None] Created reservations ['e18355aa-6b9a-4ea6-958d-a8fc8c4e7074', '782e8689-f36e-43b9-bb95-1a0f675a6083', '0209abbe-df69-44cf-a548-6df9521f96f1', 'cdfb4d56-2f55-4149-8f9d-2ddf4efde9c6'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:35:11.764334 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf20872b-9dd4-4784-a53a-0dd8acc06a0c tempest-GroupSnapshotsV319Test-374512164 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:11.814542 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf20872b-9dd4-4784-a53a-0dd8acc06a0c tempest-GroupSnapshotsV319Test-374512164 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:11.867051 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-cf20872b-9dd4-4784-a53a-0dd8acc06a0c tempest-GroupSnapshotsV319Test-374512164 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:35:11.872539 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cf20872b-9dd4-4784-a53a-0dd8acc06a0c tempest-GroupSnapshotsV319Test-374512164 None] Delete group completed successfully.
Apr 16 21:35:28.606739 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:35:28.607453 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:28.664923 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:28.715682 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:35:29.408767 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:35:29.428456 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Flow 'volume_create_manager' (c842d085-5b54-40ba-9b7b-4ee4950fa5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:35:29.436087 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9d3f46-734c-40bf-b734-720c86a856e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:35:29.459536 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9d3f46-734c-40bf-b734-720c86a856e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1173050767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6bc922f4-6c02-4e2e-94af-7b6e72d3363f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9399fc0232fe4048985b8255ce445eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:35:29Z,use_quota=True,user_id='3535df4abc824f2e957c5082f7323b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56da84ac-75da-4915-869a-027274cca97d),volume_type_id=56da84ac-75da-4915-869a-027274cca97d)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:35:29.466190 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c69215-04ff-4d68-9ed9-144793cfd479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:35:29.471355 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c69215-04ff-4d68-9ed9-144793cfd479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:35:29.477112 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f311b68-9572-4bc9-b778-7a8c776ea53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:35:29.482041 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f311b68-9572-4bc9-b778-7a8c776ea53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bc922f4-6c02-4e2e-94af-7b6e72d3363f', 'volume_name': 'volume-6bc922f4-6c02-4e2e-94af-7b6e72d3363f', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:35:29.498973 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925eeee0-624e-4a9b-9f64-8bcc97fb5c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:35:29.510284 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925eeee0-624e-4a9b-9f64-8bcc97fb5c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:35:29.521650 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa66ed0-933f-4075-aba0-a7ce61c2ea43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:35:29.523855 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Volume 6bc922f4-6c02-4e2e-94af-7b6e72d3363f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bc922f4-6c02-4e2e-94af-7b6e72d3363f', 'volume_size': 1}
Apr 16 21:35:29.524691 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] creating volume 'volume-6bc922f4-6c02-4e2e-94af-7b6e72d3363f' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:35:29.527113 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:30.145923 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:35:30.161824 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:35:30.168051 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa66ed0-933f-4075-aba0-a7ce61c2ea43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bc922f4-6c02-4e2e-94af-7b6e72d3363f', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:35:30.178000 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a95e82-99cb-4af5-847b-943a4639e343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:35:30.245692 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Volume volume-6bc922f4-6c02-4e2e-94af-7b6e72d3363f (6bc922f4-6c02-4e2e-94af-7b6e72d3363f): created successfully
Apr 16 21:35:30.250548 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a95e82-99cb-4af5-847b-943a4639e343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:35:30.256293 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Flow 'volume_create_manager' (c842d085-5b54-40ba-9b7b-4ee4950fa5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:35:30.315419 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-76394758-0f86-4a85-a191-ed28b0ddb081 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Created volume successfully.
Apr 16 21:35:32.236882 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-637b5d29-e4d2-4417-9a0d-8965420d0b88 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:32.342279 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-637b5d29-e4d2-4417-9a0d-8965420d0b88 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:32.391066 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-637b5d29-e4d2-4417-9a0d-8965420d0b88 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:35:32.402362 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-637b5d29-e4d2-4417-9a0d-8965420d0b88 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Retype volume completed successfully.
Apr 16 21:35:33.634290 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-682e28f2-fb84-49f1-adf3-d06f153feba9 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Lock "b'cinder-6bc922f4-6c02-4e2e-94af-7b6e72d3363f-delete_volume'" acquired by "delete_volume" :: waited 0.065s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:35:33.747335 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-682e28f2-fb84-49f1-adf3-d06f153feba9 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:33.933210 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-682e28f2-fb84-49f1-adf3-d06f153feba9 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:35:33.933907 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-682e28f2-fb84-49f1-adf3-d06f153feba9 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Volume volume-6bc922f4-6c02-4e2e-94af-7b6e72d3363f is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:35:34.082087 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-682e28f2-fb84-49f1-adf3-d06f153feba9 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] deleting rbd volume volume-6bc922f4-6c02-4e2e-94af-7b6e72d3363f {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:35:37.409056 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-682e28f2-fb84-49f1-adf3-d06f153feba9 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:35:37.410462 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-682e28f2-fb84-49f1-adf3-d06f153feba9 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:35:37.509880 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-682e28f2-fb84-49f1-adf3-d06f153feba9 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Created reservations ['765be4d4-f215-4138-82c6-0101e80ac255', '4dac4939-61e5-4e0c-b604-778b1ee5b134', '9007be3b-02b7-461c-91b5-da746a1d8cec', '040297a6-678e-4b7f-a625-09c7c7a0fdc3'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:35:37.722144 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-682e28f2-fb84-49f1-adf3-d06f153feba9 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:37.768689 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-682e28f2-fb84-49f1-adf3-d06f153feba9 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:37.814502 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-682e28f2-fb84-49f1-adf3-d06f153feba9 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:35:37.819827 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-682e28f2-fb84-49f1-adf3-d06f153feba9 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Deleted volume successfully.
Apr 16 21:35:37.884064 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-682e28f2-fb84-49f1-adf3-d06f153feba9 tempest-VolumeRetypeWithoutMigrationTest-205929128 None] Lock "b'cinder-6bc922f4-6c02-4e2e-94af-7b6e72d3363f-delete_volume'" released by "delete_volume" :: held 4.250s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:35:44.822242 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:35:44.860432 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Flow 'volume_create_manager' (2dbfb5a7-4ae8-42d2-8edc-384ca814f612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:35:44.869095 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa534f4-455a-4d19-96e7-0bc0a20ed1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:35:44.886817 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa534f4-455a-4d19-96e7-0bc0a20ed1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-800743236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ddd92301-6229-45b3-a68b-3f98d456adbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04eb7f2c29f4b0381248714800f8744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:35:45Z,use_quota=True,user_id='03cb4bdda11f48189bad7799b963d359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c4c48e7-400d-447a-af2d-51a34bdff1ac),volume_type_id=4c4c48e7-400d-447a-af2d-51a34bdff1ac)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:35:44.896993 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b765a7f-4ed3-4ebe-b948-c28d507223e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:35:44.903674 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b765a7f-4ed3-4ebe-b948-c28d507223e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:35:44.910836 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d493c7-b67b-48dd-a2f8-0f16c94ecc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:35:44.916727 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d493c7-b67b-48dd-a2f8-0f16c94ecc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd92301-6229-45b3-a68b-3f98d456adbe', 'volume_name': 'volume-ddd92301-6229-45b3-a68b-3f98d456adbe', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:35:44.924301 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23744b34-3c28-4ef7-b4aa-99ff1efeef87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:35:44.928906 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23744b34-3c28-4ef7-b4aa-99ff1efeef87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:35:44.935404 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ad0da3-e4e9-464e-bd2b-86eaec6005ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:35:44.937880 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Volume ddd92301-6229-45b3-a68b-3f98d456adbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd92301-6229-45b3-a68b-3f98d456adbe', 'volume_size': 1}
Apr 16 21:35:44.939635 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] creating volume 'volume-ddd92301-6229-45b3-a68b-3f98d456adbe' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:35:44.942889 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:45.532509 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:35:45.533314 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:35:45.540573 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ad0da3-e4e9-464e-bd2b-86eaec6005ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd92301-6229-45b3-a68b-3f98d456adbe', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:35:45.546567 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279a2d51-40b6-4ace-b7dc-c674b4dfdc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:35:45.652438 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Volume volume-ddd92301-6229-45b3-a68b-3f98d456adbe (ddd92301-6229-45b3-a68b-3f98d456adbe): created successfully
Apr 16 21:35:45.659284 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279a2d51-40b6-4ace-b7dc-c674b4dfdc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:35:45.670814 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Flow 'volume_create_manager' (2dbfb5a7-4ae8-42d2-8edc-384ca814f612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:35:45.728743 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a2155b56-859d-4ca1-ad3a-3401d02fdd12 tempest-VolumeTypesTest-359127411 None] Created volume successfully.
Apr 16 21:35:47.390142 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8a0f9dcf-eab9-411d-bcc8-269badc6fdd7 tempest-VolumeTypesTest-359127411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:47.437635 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8a0f9dcf-eab9-411d-bcc8-269badc6fdd7 tempest-VolumeTypesTest-359127411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:47.536055 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8a0f9dcf-eab9-411d-bcc8-269badc6fdd7 tempest-VolumeTypesTest-359127411 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:35:47.551205 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8a0f9dcf-eab9-411d-bcc8-269badc6fdd7 tempest-VolumeTypesTest-359127411 None] Retype volume completed successfully.
Apr 16 21:35:50.259777 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-dceb3246-39e0-4b9d-9dc1-de4b1a2bba8a tempest-VolumeTypesTest-359127411 None] Lock "b'cinder-ddd92301-6229-45b3-a68b-3f98d456adbe-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:35:50.390373 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dceb3246-39e0-4b9d-9dc1-de4b1a2bba8a tempest-VolumeTypesTest-359127411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:50.521386 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dceb3246-39e0-4b9d-9dc1-de4b1a2bba8a tempest-VolumeTypesTest-359127411 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:35:50.521738 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dceb3246-39e0-4b9d-9dc1-de4b1a2bba8a tempest-VolumeTypesTest-359127411 None] Volume volume-ddd92301-6229-45b3-a68b-3f98d456adbe is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:35:50.617046 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dceb3246-39e0-4b9d-9dc1-de4b1a2bba8a tempest-VolumeTypesTest-359127411 None] deleting rbd volume volume-ddd92301-6229-45b3-a68b-3f98d456adbe {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:35:54.218826 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-dceb3246-39e0-4b9d-9dc1-de4b1a2bba8a tempest-VolumeTypesTest-359127411 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-949260148 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-949260148, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:35:54.219808 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-dceb3246-39e0-4b9d-9dc1-de4b1a2bba8a tempest-VolumeTypesTest-359127411 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-949260148 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-949260148, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:35:54.269941 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-dceb3246-39e0-4b9d-9dc1-de4b1a2bba8a tempest-VolumeTypesTest-359127411 None] Created reservations ['60faa067-b2ef-4352-9512-616976e797b1', '152bd40b-43d3-4445-b6dc-8b4569c001c7', '70503ff6-cb27-40ae-a8c9-7b99c7da7472', '499502f7-0f63-4cc0-ad91-de9f33feaecd'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:35:54.453951 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dceb3246-39e0-4b9d-9dc1-de4b1a2bba8a tempest-VolumeTypesTest-359127411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:54.484560 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dceb3246-39e0-4b9d-9dc1-de4b1a2bba8a tempest-VolumeTypesTest-359127411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:35:54.542323 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-dceb3246-39e0-4b9d-9dc1-de4b1a2bba8a tempest-VolumeTypesTest-359127411 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:35:54.555804 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-dceb3246-39e0-4b9d-9dc1-de4b1a2bba8a tempest-VolumeTypesTest-359127411 None] Deleted volume successfully.
Apr 16 21:35:54.703807 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-dceb3246-39e0-4b9d-9dc1-de4b1a2bba8a tempest-VolumeTypesTest-359127411 None] Lock "b'cinder-ddd92301-6229-45b3-a68b-3f98d456adbe-delete_volume'" released by "delete_volume" :: held 4.452s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:36:01.157421 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:36:01.195096 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Flow 'volume_create_manager' (588a28f6-a137-4f92-b303-010b530856de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:36:01.205950 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c769f9fe-2885-49e8-a6d6-18af655ae3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:01.227658 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c769f9fe-2885-49e8-a6d6-18af655ae3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-839174161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5b6ddcce-64a6-4813-bff3-73c4e4ef81d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3a8f4590014b8d9738bd3739f08c0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:36:01Z,use_quota=True,user_id='e007558161974720bb11a4e7588af0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:01.234487 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00f37b9-443c-4d64-9c96-ff5eff1ee961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:01.239230 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00f37b9-443c-4d64-9c96-ff5eff1ee961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:01.248553 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b893b7ab-8176-4557-9885-5d7b30df9411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:01.253583 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b893b7ab-8176-4557-9885-5d7b30df9411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b6ddcce-64a6-4813-bff3-73c4e4ef81d6', 'volume_name': 'volume-5b6ddcce-64a6-4813-bff3-73c4e4ef81d6', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:01.263791 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f76735-c3bc-477e-9f62-c34967deec24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:01.267945 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f76735-c3bc-477e-9f62-c34967deec24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:01.272915 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5eade0-3de0-45ad-91ed-225e99c5da86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:01.275383 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Volume 5b6ddcce-64a6-4813-bff3-73c4e4ef81d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b6ddcce-64a6-4813-bff3-73c4e4ef81d6', 'volume_size': 1}
Apr 16 21:36:01.275383 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] creating volume 'volume-5b6ddcce-64a6-4813-bff3-73c4e4ef81d6' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:36:01.275648 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:01.841585 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:36:01.841936 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:36:01.846869 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5eade0-3de0-45ad-91ed-225e99c5da86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b6ddcce-64a6-4813-bff3-73c4e4ef81d6', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:01.854788 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ba02ac-84e2-4487-afe1-3606159cb833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:01.949476 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Volume volume-5b6ddcce-64a6-4813-bff3-73c4e4ef81d6 (5b6ddcce-64a6-4813-bff3-73c4e4ef81d6): created successfully
Apr 16 21:36:01.954579 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ba02ac-84e2-4487-afe1-3606159cb833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:01.961980 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Flow 'volume_create_manager' (588a28f6-a137-4f92-b303-010b530856de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:36:02.035895 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4be94716-abda-4c93-b8e0-402e71225605 tempest-AttachVolumeShelveTestJSON-1483033820 None] Created volume successfully.
Apr 16 21:36:07.145285 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:36:07.163458 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Flow 'volume_create_manager' (b5a02451-8c97-4489-96e8-ffa3ac14d3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:36:07.171738 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970ee597-a082-4602-8d78-afe9fbdf3776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:07.187834 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970ee597-a082-4602-8d78-afe9fbdf3776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-141884199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4c1c5641-bb73-4ced-afe5-f587b276aa13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07424242c9824240ab0da0ebcb94a922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:36:07Z,use_quota=True,user_id='1257e67ecabf40b3baece15fe68f4bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:07.195233 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5595fe7c-e1ef-4fa3-9330-383caa9c77e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:07.197568 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5595fe7c-e1ef-4fa3-9330-383caa9c77e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:07.202881 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27a2509-b7ff-45c1-8e9d-6fa348564db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:07.207098 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27a2509-b7ff-45c1-8e9d-6fa348564db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c1c5641-bb73-4ced-afe5-f587b276aa13', 'volume_name': 'volume-4c1c5641-bb73-4ced-afe5-f587b276aa13', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:07.212234 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa027a6-0fa6-4f9d-9f49-65a81d6ee10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:07.216791 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa027a6-0fa6-4f9d-9f49-65a81d6ee10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:07.221682 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39871394-2a7d-453f-bf33-c8c5eb3396b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:07.222772 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Volume 4c1c5641-bb73-4ced-afe5-f587b276aa13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c1c5641-bb73-4ced-afe5-f587b276aa13', 'volume_size': 1}
Apr 16 21:36:07.223169 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] creating volume 'volume-4c1c5641-bb73-4ced-afe5-f587b276aa13' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:36:07.223837 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:07.742587 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:36:07.743218 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:36:07.747245 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39871394-2a7d-453f-bf33-c8c5eb3396b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c1c5641-bb73-4ced-afe5-f587b276aa13', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:07.752503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0daabda2-5f9e-4b93-a96e-7403f5a08135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:07.801948 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Volume volume-4c1c5641-bb73-4ced-afe5-f587b276aa13 (4c1c5641-bb73-4ced-afe5-f587b276aa13): created successfully
Apr 16 21:36:07.806315 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0daabda2-5f9e-4b93-a96e-7403f5a08135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:07.821105 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Flow 'volume_create_manager' (b5a02451-8c97-4489-96e8-ffa3ac14d3da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:36:07.904135 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9d9baed7-1698-46af-9cb1-ddde37c7fc9d tempest-SnapshotMetadataTestJSON-2080222530 None] Created volume successfully.
Apr 16 21:36:08.571686 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-28f5d625-9706-46fa-af60-e16ee0332374 tempest-SnapshotMetadataTestJSON-2080222530 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:10.682043 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-28f5d625-9706-46fa-af60-e16ee0332374 tempest-SnapshotMetadataTestJSON-2080222530 None] Create snapshot completed successfully
Apr 16 21:36:12.904642 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-265356a1-ce97-41f5-ac99-f964ea878846 tempest-SnapshotMetadataTestJSON-2080222530 None] Lock "b'cinder-7447f424-149f-4851-825e-3a8ad64441b2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.031s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:36:12.914439 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-265356a1-ce97-41f5-ac99-f964ea878846 tempest-SnapshotMetadataTestJSON-2080222530 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:15.190748 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-265356a1-ce97-41f5-ac99-f964ea878846 tempest-SnapshotMetadataTestJSON-2080222530 None] Created reservations ['dbe79ad0-28ee-4a60-bb1a-ac92a7261082', 'dbe39e2c-0947-41d6-a1e6-a28e37f858d5', '4fdcb8f4-3ed1-4251-929d-1564e512c730', '91d58bc0-ed5a-423c-8b11-33241396b93d'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:36:15.400079 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-265356a1-ce97-41f5-ac99-f964ea878846 tempest-SnapshotMetadataTestJSON-2080222530 None] Delete snapshot completed successfully.
Apr 16 21:36:15.405695 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-265356a1-ce97-41f5-ac99-f964ea878846 tempest-SnapshotMetadataTestJSON-2080222530 None] Lock "b'cinder-7447f424-149f-4851-825e-3a8ad64441b2-delete_snapshot'" released by "delete_snapshot" :: held 2.501s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:36:16.430869 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1d13f114-8843-48a1-84f3-e012dac4ee7a tempest-SnapshotMetadataTestJSON-2080222530 None] Lock "b'cinder-4c1c5641-bb73-4ced-afe5-f587b276aa13-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:36:16.615754 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1d13f114-8843-48a1-84f3-e012dac4ee7a tempest-SnapshotMetadataTestJSON-2080222530 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:16.875115 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1d13f114-8843-48a1-84f3-e012dac4ee7a tempest-SnapshotMetadataTestJSON-2080222530 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:36:16.875610 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1d13f114-8843-48a1-84f3-e012dac4ee7a tempest-SnapshotMetadataTestJSON-2080222530 None] Volume volume-4c1c5641-bb73-4ced-afe5-f587b276aa13 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:36:17.007211 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1d13f114-8843-48a1-84f3-e012dac4ee7a tempest-SnapshotMetadataTestJSON-2080222530 None] deleting rbd volume volume-4c1c5641-bb73-4ced-afe5-f587b276aa13 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:36:20.493226 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-1d13f114-8843-48a1-84f3-e012dac4ee7a tempest-SnapshotMetadataTestJSON-2080222530 None] Created reservations ['320200be-f2b7-472d-95ef-65e8d5ec5013', '29883d14-f76f-44c2-822d-c366dace1c7c', 'd54b2b15-b022-4870-af34-0146175f4dc6', '4eccb7b9-f5d0-4e71-af7a-c67ffd50dcd1'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:36:20.795758 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1d13f114-8843-48a1-84f3-e012dac4ee7a tempest-SnapshotMetadataTestJSON-2080222530 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:20.832527 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1d13f114-8843-48a1-84f3-e012dac4ee7a tempest-SnapshotMetadataTestJSON-2080222530 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:20.884605 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-1d13f114-8843-48a1-84f3-e012dac4ee7a tempest-SnapshotMetadataTestJSON-2080222530 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:36:20.899537 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1d13f114-8843-48a1-84f3-e012dac4ee7a tempest-SnapshotMetadataTestJSON-2080222530 None] Deleted volume successfully.
Apr 16 21:36:20.988370 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1d13f114-8843-48a1-84f3-e012dac4ee7a tempest-SnapshotMetadataTestJSON-2080222530 None] Lock "b'cinder-4c1c5641-bb73-4ced-afe5-f587b276aa13-delete_volume'" released by "delete_volume" :: held 4.558s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:36:24.850681 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cb545283-64c6-4b25-bf01-8c304f2a942c tempest-BackendsCapabilitiesAdminTestsJSON-427725172 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:ede3d8f1-0842-4fe6-bb98-99ca97eaad35:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=130674) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4731}}
Apr 16 21:36:24.892712 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e0a94b32-05b0-4e5f-a340-55be203005f8 tempest-BackendsCapabilitiesAdminTestsJSON-427725172 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:ede3d8f1-0842-4fe6-bb98-99ca97eaad35:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=130674) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4731}}
Apr 16 21:36:25.176766 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:36:25.208468 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Flow 'volume_create_manager' (3261dc4c-2e1d-4707-a44c-f00de4690ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:36:25.224189 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a16acb8-1309-4dd7-9e0d-1e39b5f02ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:25.245429 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a16acb8-1309-4dd7-9e0d-1e39b5f02ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-763456046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=20bcbc32-e2bc-43f6-96f9-6dc90f5c3625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d199a282ddd43ccbb49a8b9a213237d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:36:25Z,use_quota=True,user_id='55bb5f285ad84d7fbd6a63d0224da362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:25.252351 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc79d7e5-0366-4f7f-8c70-186d3d5bae0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:25.259961 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc79d7e5-0366-4f7f-8c70-186d3d5bae0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:25.266066 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf79e90-17d5-4539-ad24-a5fb3fc72195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:25.272130 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf79e90-17d5-4539-ad24-a5fb3fc72195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20bcbc32-e2bc-43f6-96f9-6dc90f5c3625', 'volume_name': 'volume-20bcbc32-e2bc-43f6-96f9-6dc90f5c3625', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:25.280393 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67028567-62a2-423e-acc4-6a245d079f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:25.285182 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67028567-62a2-423e-acc4-6a245d079f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:25.309369 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63f81c4-27b2-4cc6-9304-0ba7be5923aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:25.312075 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Volume 20bcbc32-e2bc-43f6-96f9-6dc90f5c3625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20bcbc32-e2bc-43f6-96f9-6dc90f5c3625', 'volume_size': 1}
Apr 16 21:36:25.317457 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] creating volume 'volume-20bcbc32-e2bc-43f6-96f9-6dc90f5c3625' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:36:25.318982 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:26.016777 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:36:26.017461 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:36:26.020846 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63f81c4-27b2-4cc6-9304-0ba7be5923aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20bcbc32-e2bc-43f6-96f9-6dc90f5c3625', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:26.026168 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e0996c-d217-401d-af78-d375a61ab738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:26.108627 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Volume volume-20bcbc32-e2bc-43f6-96f9-6dc90f5c3625 (20bcbc32-e2bc-43f6-96f9-6dc90f5c3625): created successfully
Apr 16 21:36:26.117060 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e0996c-d217-401d-af78-d375a61ab738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:26.140970 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Flow 'volume_create_manager' (3261dc4c-2e1d-4707-a44c-f00de4690ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:36:26.212747 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-23f1941e-a467-4c93-889d-229ae7d393d2 tempest-VolumesDeleteCascade-271607775 None] Created volume successfully.
Apr 16 21:36:27.962537 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-651d7519-1183-41ae-a4e5-687db06b5b8b tempest-VolumesDeleteCascade-271607775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:28.611534 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:36:28.612217 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:28.686194 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:28.748842 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:36:30.994166 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-651d7519-1183-41ae-a4e5-687db06b5b8b tempest-VolumesDeleteCascade-271607775 None] Create snapshot completed successfully
Apr 16 21:36:32.710167 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-70b0f3cc-1ab0-4b3f-a42b-1d51dafb8a88 tempest-VolumesDeleteCascade-271607775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:34.571280 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-70b0f3cc-1ab0-4b3f-a42b-1d51dafb8a88 tempest-VolumesDeleteCascade-271607775 None] Create snapshot completed successfully
Apr 16 21:36:36.203128 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] Lock "b'cinder-20bcbc32-e2bc-43f6-96f9-6dc90f5c3625-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:36:36.468489 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] Performing cascade delete. {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/manager.py:963}}
Apr 16 21:36:36.491120 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] Lock "b'cinder-05753d8f-d136-4ba9-a183-d94b1194cb21-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:36:36.503967 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:39.691394 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] Created reservations ['3a3d4c4e-93b1-4ec4-ba9f-6604da339389', '6a4dfea2-1ec3-4183-919d-503f3552910f', '6dcb399e-9686-46bb-bbdd-40354f6ce34a', 'f41f7d83-3feb-48ba-bcc4-eedb2e2d53e7'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:36:39.890596 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] Delete snapshot completed successfully.
Apr 16 21:36:39.895727 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] Lock "b'cinder-05753d8f-d136-4ba9-a183-d94b1194cb21-delete_snapshot'" released by "delete_snapshot" :: held 3.405s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:36:39.911234 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] Lock "b'cinder-8a6c564f-23e1-4e1b-9158-c7124fb68ccc-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:36:39.931688 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:41.149483 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:36:41.171632 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Flow 'volume_create_manager' (dcec9b5b-78f9-49b2-b82d-eba94515ce8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:36:41.179943 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26814499-fb7e-4178-8b8b-255efe874ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:41.202709 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26814499-fb7e-4178-8b8b-255efe874ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-804923834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=601af126-92fa-49b4-803e-a0d258bc7182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b9e5c6d49248198e02c29a3e162acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:36:41Z,use_quota=True,user_id='894b0f3d782a4e53a9f4db1732c2e592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:41.215314 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c4c8e3-9e22-4314-a676-a2d00751becc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:41.215314 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c4c8e3-9e22-4314-a676-a2d00751becc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:41.217614 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71a6dd1-90c1-4ad0-8e7e-5a9067906d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:41.221660 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71a6dd1-90c1-4ad0-8e7e-5a9067906d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '601af126-92fa-49b4-803e-a0d258bc7182', 'volume_name': 'volume-601af126-92fa-49b4-803e-a0d258bc7182', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:41.227218 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e94cdc4-a66b-44d7-83c2-783c76ff4365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:41.231104 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e94cdc4-a66b-44d7-83c2-783c76ff4365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:41.235818 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741144f3-1ac7-49e8-9a02-4b269605107d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:41.236914 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Volume 601af126-92fa-49b4-803e-a0d258bc7182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-601af126-92fa-49b4-803e-a0d258bc7182', 'volume_size': 1}
Apr 16 21:36:41.237302 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] creating volume 'volume-601af126-92fa-49b4-803e-a0d258bc7182' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:36:41.238082 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:41.847779 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:36:41.848153 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:36:41.854718 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741144f3-1ac7-49e8-9a02-4b269605107d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-601af126-92fa-49b4-803e-a0d258bc7182', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:41.865830 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae110e9-4871-4fe6-966f-3019d0d7e5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:41.930291 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Volume volume-601af126-92fa-49b4-803e-a0d258bc7182 (601af126-92fa-49b4-803e-a0d258bc7182): created successfully
Apr 16 21:36:41.934073 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae110e9-4871-4fe6-966f-3019d0d7e5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:41.939629 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Flow 'volume_create_manager' (dcec9b5b-78f9-49b2-b82d-eba94515ce8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:36:41.987452 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-39570f19-c6e1-4015-89ac-f64fa0af31ce tempest-VolumesServicesTestJSON-913086436 None] Created volume successfully.
Apr 16 21:36:43.198988 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] Created reservations ['ae8d4e3c-0718-4095-8656-a383b0165507', '888e50d3-9d8f-4e6e-b535-efa59884bc58', '88d17ec7-4fea-43bf-a911-6bdc4a81b0d1', '392b2f1c-634c-4647-9168-c52af3817e5a'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:36:43.249368 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-586683fa-e7b5-4906-bb0e-8abbbb82948b tempest-VolumesServicesTestJSON-913086436 None] Lock "b'cinder-601af126-92fa-49b4-803e-a0d258bc7182-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:36:43.391733 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-586683fa-e7b5-4906-bb0e-8abbbb82948b tempest-VolumesServicesTestJSON-913086436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:43.552884 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-586683fa-e7b5-4906-bb0e-8abbbb82948b tempest-VolumesServicesTestJSON-913086436 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:36:43.553318 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-586683fa-e7b5-4906-bb0e-8abbbb82948b tempest-VolumesServicesTestJSON-913086436 None] Volume volume-601af126-92fa-49b4-803e-a0d258bc7182 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:36:43.668644 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-586683fa-e7b5-4906-bb0e-8abbbb82948b tempest-VolumesServicesTestJSON-913086436 None] deleting rbd volume volume-601af126-92fa-49b4-803e-a0d258bc7182 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:36:43.679603 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] Delete snapshot completed successfully.
Apr 16 21:36:43.692313 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] Lock "b'cinder-8a6c564f-23e1-4e1b-9158-c7124fb68ccc-delete_snapshot'" released by "delete_snapshot" :: held 3.786s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:36:43.693725 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] Snapshots deleted, issuing volume delete {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/manager.py:978}}
Apr 16 21:36:43.694940 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:43.924227 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:36:43.924227 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] Volume volume-20bcbc32-e2bc-43f6-96f9-6dc90f5c3625 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:36:44.182727 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] deleting rbd volume volume-20bcbc32-e2bc-43f6-96f9-6dc90f5c3625 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:36:44.344472 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-756100a7-b8b6-4bbc-8a8b-300babb29717 req-16b38f4c-3f81-4122-8e07-7f9fe2b09daf tempest-AttachVolumeShelveTestJSON-1483033820 None] No connector for attachment 4b3b290f-b2e9-44f0-b4f7-e53e00dfb185; skipping storage backend terminate_connection call. {{(pid=130674) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4908}}
Apr 16 21:36:44.345565 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-756100a7-b8b6-4bbc-8a8b-300babb29717 req-16b38f4c-3f81-4122-8e07-7f9fe2b09daf tempest-AttachVolumeShelveTestJSON-1483033820 None] Deleting attachment 4b3b290f-b2e9-44f0-b4f7-e53e00dfb185. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:36:47.367570 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-04c71519-07dd-403b-946d-5276407b1bd7 tempest-GroupsV314Test-1796893369 None] Group tempest-GroupsV314Test-Group-595912860: creating
Apr 16 21:36:47.448794 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-04c71519-07dd-403b-946d-5276407b1bd7 tempest-GroupsV314Test-1796893369 None] Group tempest-GroupsV314Test-Group-595912860: created successfully
Apr 16 21:36:47.457693 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-04c71519-07dd-403b-946d-5276407b1bd7 tempest-GroupsV314Test-1796893369 None] Create group completed successfully.
Apr 16 21:36:47.596445 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-42ecf42e-2534-4260-9bd1-3416c7a16154 tempest-GroupsTest-26708387 None] Group tempest-Group1-1885212225: creating
Apr 16 21:36:47.693939 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-42ecf42e-2534-4260-9bd1-3416c7a16154 tempest-GroupsTest-26708387 None] Group tempest-Group1-1885212225: created successfully
Apr 16 21:36:47.702589 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-42ecf42e-2534-4260-9bd1-3416c7a16154 tempest-GroupsTest-26708387 None] Create group completed successfully.
Apr 16 21:36:49.197186 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4b118e60-ec05-4087-89d7-7ab939665df1 tempest-GroupsTest-26708387 None] Group tempest-Group2-1023382567: creating
Apr 16 21:36:49.310722 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4b118e60-ec05-4087-89d7-7ab939665df1 tempest-GroupsTest-26708387 None] Group tempest-Group2-1023382567: created successfully
Apr 16 21:36:49.315789 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4b118e60-ec05-4087-89d7-7ab939665df1 tempest-GroupsTest-26708387 None] Create group completed successfully.
Apr 16 21:36:49.497562 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:36:49.527023 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Flow 'volume_create_manager' (c865cc54-f872-4a3f-86a8-d03fbb2fe119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:36:49.537413 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c387ded9-2829-436d-9cae-c41c0595e046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:49.555806 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c387ded9-2829-436d-9cae-c41c0595e046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-1692434171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=91c45864-0d5f-4663-8ad8-c14e88a2f5c3,host='ncdv-master-1@ceph#ceph',id=c7a9af68-5c2a-4f5e-8ee0-ce482c957778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead8493102964fdca1d22b36ba238c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:36:49Z,use_quota=True,user_id='615652c754e447ffa5aa741901e34830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41c368a3-4066-4866-b8ac-97dc27aaae01),volume_type_id=41c368a3-4066-4866-b8ac-97dc27aaae01)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:49.563446 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beed83be-7b7b-4e78-af05-c3292dbdacc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:49.567936 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beed83be-7b7b-4e78-af05-c3292dbdacc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:49.574701 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50693d0d-e828-44c0-af28-a276ae2bbb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:49.579251 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50693d0d-e828-44c0-af28-a276ae2bbb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7a9af68-5c2a-4f5e-8ee0-ce482c957778', 'volume_name': 'volume-c7a9af68-5c2a-4f5e-8ee0-ce482c957778', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:49.584771 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0e29c0-346a-429f-a2e4-46d7f1cefaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:49.589664 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0e29c0-346a-429f-a2e4-46d7f1cefaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:49.596051 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74ef9b3-136a-466f-aff5-c39cce5b895d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:49.597886 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Volume c7a9af68-5c2a-4f5e-8ee0-ce482c957778: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7a9af68-5c2a-4f5e-8ee0-ce482c957778', 'volume_size': 1}
Apr 16 21:36:49.598481 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] creating volume 'volume-c7a9af68-5c2a-4f5e-8ee0-ce482c957778' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:36:49.599301 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:50.037653 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-586683fa-e7b5-4906-bb0e-8abbbb82948b tempest-VolumesServicesTestJSON-913086436 None] Created reservations ['9660cfa7-d3ac-4318-b50b-c3b3f3fb8944', 'cb6ddd22-cacf-4d03-a3ab-fae4af3313d1', '1528a01d-f7fe-4ff6-920c-73d6898bd5bf', '8ee97e77-9681-4833-acea-462b99588d15'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:36:50.216067 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-586683fa-e7b5-4906-bb0e-8abbbb82948b tempest-VolumesServicesTestJSON-913086436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:50.271980 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-586683fa-e7b5-4906-bb0e-8abbbb82948b tempest-VolumesServicesTestJSON-913086436 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:50.381072 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-586683fa-e7b5-4906-bb0e-8abbbb82948b tempest-VolumesServicesTestJSON-913086436 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:36:50.392316 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-586683fa-e7b5-4906-bb0e-8abbbb82948b tempest-VolumesServicesTestJSON-913086436 None] Deleted volume successfully.
Apr 16 21:36:50.484739 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-586683fa-e7b5-4906-bb0e-8abbbb82948b tempest-VolumesServicesTestJSON-913086436 None] Lock "b'cinder-601af126-92fa-49b4-803e-a0d258bc7182-delete_volume'" released by "delete_volume" :: held 7.235s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:36:50.506138 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] Created reservations ['10732da0-fbdf-45e4-bbd5-85a34d9ebca0', '99dda585-b761-4040-8927-9b111a944680', 'c4917c14-5498-4858-bb70-5b3aa0eca21d', '8b7acd63-448a-47e9-85e7-fafdb45f1247'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:36:50.522993 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:36:50.523472 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:36:50.530760 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74ef9b3-136a-466f-aff5-c39cce5b895d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a9af68-5c2a-4f5e-8ee0-ce482c957778', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:50.536426 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d53147-d783-4ec0-83f9-e8ef6b671a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:50.651028 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Volume volume-c7a9af68-5c2a-4f5e-8ee0-ce482c957778 (c7a9af68-5c2a-4f5e-8ee0-ce482c957778): created successfully
Apr 16 21:36:50.654768 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d53147-d783-4ec0-83f9-e8ef6b671a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:50.660369 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Flow 'volume_create_manager' (c865cc54-f872-4a3f-86a8-d03fbb2fe119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:36:50.800717 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:50.847155 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:50.874627 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:36:50.877082 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f88d3754-ed2e-4c5f-8e11-2cb13ee2bc32 tempest-GroupsV314Test-1796893369 None] Created volume successfully.
Apr 16 21:36:50.882228 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] Deleted volume successfully.
Apr 16 21:36:51.030979 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-677d036f-45ff-4d81-8a3d-47a1ad13f9e1 tempest-VolumesDeleteCascade-271607775 None] Lock "b'cinder-20bcbc32-e2bc-43f6-96f9-6dc90f5c3625-delete_volume'" released by "delete_volume" :: held 14.828s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:36:51.371341 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:36:51.407268 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Flow 'volume_create_manager' (61c5a0de-d7fc-4674-bdab-f350e44065cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:36:51.416190 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee6f5c3-dc1e-49ce-a8f6-793007fe4836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:51.432788 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee6f5c3-dc1e-49ce-a8f6-793007fe4836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-652139263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=023e2e12-50a7-4c58-bdaa-7a22d5992883,host='ncdv-master-1@ceph#ceph',id=f2742a0c-5f60-4e43-9f21-54a5a45d7ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c51bc2236745d894d65a60227fff09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:36:51Z,use_quota=True,user_id='a5df433620994ea6891ffb0050f8b594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74f63eaf-2121-44f1-8688-0d4b24525bb1),volume_type_id=74f63eaf-2121-44f1-8688-0d4b24525bb1)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:51.438823 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b26cf7e-005c-4484-b6c1-a6e37c98f9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:51.443102 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b26cf7e-005c-4484-b6c1-a6e37c98f9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:51.449870 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0b2830-510d-4924-93fa-f7393e3800d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:51.463145 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0b2830-510d-4924-93fa-f7393e3800d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2742a0c-5f60-4e43-9f21-54a5a45d7ca1', 'volume_name': 'volume-f2742a0c-5f60-4e43-9f21-54a5a45d7ca1', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:51.470815 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdaaa479-2cee-4d97-9603-0aaba65bae0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:51.475035 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdaaa479-2cee-4d97-9603-0aaba65bae0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:51.482044 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08f7ee8-df3b-44d0-b26e-236db097dbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:51.483754 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Volume f2742a0c-5f60-4e43-9f21-54a5a45d7ca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2742a0c-5f60-4e43-9f21-54a5a45d7ca1', 'volume_size': 1}
Apr 16 21:36:51.484288 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] creating volume 'volume-f2742a0c-5f60-4e43-9f21-54a5a45d7ca1' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:36:51.485164 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:52.018418 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:36:52.018815 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:36:52.023035 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08f7ee8-df3b-44d0-b26e-236db097dbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2742a0c-5f60-4e43-9f21-54a5a45d7ca1', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:52.027844 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f353a02-59a0-4945-9307-d386c064dc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:52.095410 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Volume volume-f2742a0c-5f60-4e43-9f21-54a5a45d7ca1 (f2742a0c-5f60-4e43-9f21-54a5a45d7ca1): created successfully
Apr 16 21:36:52.099401 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f353a02-59a0-4945-9307-d386c064dc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:52.105186 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Flow 'volume_create_manager' (61c5a0de-d7fc-4674-bdab-f350e44065cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:36:52.177517 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6cc5474e-f89e-4957-800d-4c1e8bb315b1 tempest-GroupsTest-26708387 None] Created volume successfully.
Apr 16 21:36:52.425602 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e14c32a-881a-4435-888b-bbc40124c73e tempest-GroupsV314Test-1796893369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:52.592906 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e14c32a-881a-4435-888b-bbc40124c73e tempest-GroupsV314Test-1796893369 None] creating snapshot='volume-6880443b-c24b-4053-884d-43e7fbc63204.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:36:54.370481 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e14c32a-881a-4435-888b-bbc40124c73e tempest-GroupsV314Test-1796893369 None] cloning 'volume-c7a9af68-5c2a-4f5e-8ee0-ce482c957778@volume-6880443b-c24b-4053-884d-43e7fbc63204.clone_snap' to 'volume-6880443b-c24b-4053-884d-43e7fbc63204' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:36:54.440778 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e0b6c2fd-2744-456b-81bc-360f62542a25 tempest-GroupsTest-26708387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:54.763458 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e0b6c2fd-2744-456b-81bc-360f62542a25 tempest-GroupsTest-26708387 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:36:54.764055 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e0b6c2fd-2744-456b-81bc-360f62542a25 tempest-GroupsTest-26708387 None] Volume volume-f2742a0c-5f60-4e43-9f21-54a5a45d7ca1 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:36:55.086833 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e0b6c2fd-2744-456b-81bc-360f62542a25 tempest-GroupsTest-26708387 None] deleting rbd volume volume-f2742a0c-5f60-4e43-9f21-54a5a45d7ca1 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:36:56.021247 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:36:56.080403 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Flow 'volume_create_manager' (da74708d-13a1-44eb-9766-ae84c2c13eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:36:56.086451 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32031f25-dd91-4067-8913-15715568888b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:56.107124 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32031f25-dd91-4067-8913-15715568888b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1404578008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51b576f9c0241c1a254f15308a455ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:36:56Z,use_quota=True,user_id='77f61ccbf5114e6080e33f0c5f500468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:56.115301 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83c6de5-67d4-4028-8264-0f8cbbb31615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:56.121324 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83c6de5-67d4-4028-8264-0f8cbbb31615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:56.127736 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebdb5de-e70d-45e7-be13-3cd0c3a83c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:56.132665 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebdb5de-e70d-45e7-be13-3cd0c3a83c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861', 'volume_name': 'volume-0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:56.139126 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f4dcb9-5253-412d-84a2-bc878218b132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:56.143954 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f4dcb9-5253-412d-84a2-bc878218b132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:56.150124 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45d06f7-5088-4262-8e1c-f26de030ae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:56.151713 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Volume 0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861', 'volume_size': 1}
Apr 16 21:36:56.152300 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] creating volume 'volume-0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:36:56.153133 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:56.346399 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e14c32a-881a-4435-888b-bbc40124c73e tempest-GroupsV314Test-1796893369 None] Volume volume-c7a9af68-5c2a-4f5e-8ee0-ce482c957778 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:36:56.364150 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e14c32a-881a-4435-888b-bbc40124c73e tempest-GroupsV314Test-1796893369 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:36:56.365051 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e14c32a-881a-4435-888b-bbc40124c73e tempest-GroupsV314Test-1796893369 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:36:57.030738 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e14c32a-881a-4435-888b-bbc40124c73e tempest-GroupsV314Test-1796893369 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:36:57.040787 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:36:57.041279 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:36:57.050526 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45d06f7-5088-4262-8e1c-f26de030ae38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:57.068351 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08c2a6d-7c4d-46df-81bc-d099d40da222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:36:57.157926 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Volume volume-0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861 (0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861): created successfully
Apr 16 21:36:57.167293 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08c2a6d-7c4d-46df-81bc-d099d40da222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:36:57.183297 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Flow 'volume_create_manager' (da74708d-13a1-44eb-9766-ae84c2c13eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:36:57.282031 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d9981dde-873b-4b32-82c1-ea858dbfcccd tempest-VolumesBackupsTest-493584864 None] Created volume successfully.
Apr 16 21:36:57.495980 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3e14c32a-881a-4435-888b-bbc40124c73e tempest-GroupsV314Test-1796893369 None] Create group from source-group-91c45864-0d5f-4663-8ad8-c14e88a2f5c3 completed successfully.
Apr 16 21:36:58.932108 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf4eda0a-8f5f-46f3-ba6e-0329c0495416 tempest-GroupsV314Test-1796893369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:36:59.500740 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf4eda0a-8f5f-46f3-ba6e-0329c0495416 tempest-GroupsV314Test-1796893369 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:36:59.782101 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf4eda0a-8f5f-46f3-ba6e-0329c0495416 tempest-GroupsV314Test-1796893369 None] deleting rbd volume volume-6880443b-c24b-4053-884d-43e7fbc63204 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:37:01.306796 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-e0b6c2fd-2744-456b-81bc-360f62542a25 tempest-GroupsTest-26708387 None] Created reservations ['8ee46f5d-180b-49e8-aa16-ac7bbb86f549'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:37:01.325050 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-e0b6c2fd-2744-456b-81bc-360f62542a25 tempest-GroupsTest-26708387 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-277386866 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-277386866, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:37:01.325858 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-e0b6c2fd-2744-456b-81bc-360f62542a25 tempest-GroupsTest-26708387 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-277386866 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-277386866, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:37:01.448795 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-e0b6c2fd-2744-456b-81bc-360f62542a25 tempest-GroupsTest-26708387 None] Created reservations ['70ade603-2832-45a8-b37e-87e8da6d99e8', 'a562c762-4ed1-4685-832b-158db9152c55', '7ccf0076-46f8-4b58-b272-73e2a4260fe1', 'fadbe7f8-48d7-4d12-9806-32f8c0bcce49'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:37:01.870834 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e0b6c2fd-2744-456b-81bc-360f62542a25 tempest-GroupsTest-26708387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:01.896809 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e0b6c2fd-2744-456b-81bc-360f62542a25 tempest-GroupsTest-26708387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:01.931617 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-e0b6c2fd-2744-456b-81bc-360f62542a25 tempest-GroupsTest-26708387 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:37:01.936039 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e0b6c2fd-2744-456b-81bc-360f62542a25 tempest-GroupsTest-26708387 None] Delete group completed successfully.
Apr 16 21:37:02.448079 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-2098d574-2fb5-49cb-b255-b60b2fb50a96 tempest-GroupsTest-26708387 None] Created reservations ['f0fe13df-028d-49df-a5c4-95a6dc25a13b'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:37:02.654506 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2098d574-2fb5-49cb-b255-b60b2fb50a96 tempest-GroupsTest-26708387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:02.690321 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2098d574-2fb5-49cb-b255-b60b2fb50a96 tempest-GroupsTest-26708387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:02.725721 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-2098d574-2fb5-49cb-b255-b60b2fb50a96 tempest-GroupsTest-26708387 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:37:02.730302 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2098d574-2fb5-49cb-b255-b60b2fb50a96 tempest-GroupsTest-26708387 None] Delete group completed successfully.
Apr 16 21:37:04.252467 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf4eda0a-8f5f-46f3-ba6e-0329c0495416 tempest-GroupsV314Test-1796893369 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:37:04.363834 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf4eda0a-8f5f-46f3-ba6e-0329c0495416 tempest-GroupsV314Test-1796893369 None] Volume volume-c7a9af68-5c2a-4f5e-8ee0-ce482c957778 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:37:04.364487 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf4eda0a-8f5f-46f3-ba6e-0329c0495416 tempest-GroupsV314Test-1796893369 None] deleting parent snapshot volume-6880443b-c24b-4053-884d-43e7fbc63204.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:37:07.526238 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-75973579-8b59-4b23-8556-5dc44f005d16 tempest-GroupsTest-26708387 None] Group tempest-GroupsTest-Group-207848289: creating
Apr 16 21:37:07.694668 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-75973579-8b59-4b23-8556-5dc44f005d16 tempest-GroupsTest-26708387 None] Group tempest-GroupsTest-Group-207848289: created successfully
Apr 16 21:37:07.702808 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-75973579-8b59-4b23-8556-5dc44f005d16 tempest-GroupsTest-26708387 None] Create group completed successfully.
Apr 16 21:37:07.831217 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-cf4eda0a-8f5f-46f3-ba6e-0329c0495416 tempest-GroupsV314Test-1796893369 None] Created reservations ['7f24d3d5-7b11-4afb-8d93-22d028cb439b'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:37:07.849736 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-cf4eda0a-8f5f-46f3-ba6e-0329c0495416 tempest-GroupsV314Test-1796893369 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2112124798 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2112124798, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:37:07.850538 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-cf4eda0a-8f5f-46f3-ba6e-0329c0495416 tempest-GroupsV314Test-1796893369 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2112124798 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2112124798, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:37:07.946472 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-cf4eda0a-8f5f-46f3-ba6e-0329c0495416 tempest-GroupsV314Test-1796893369 None] Created reservations ['93bbdffd-c67f-439f-8c49-f891559f9bc2', '5a0e0ca3-7fe5-49f1-bcbd-154fe17f25ed', '0ccf38c7-8639-44d9-88a3-6119e7a4e479', 'ef6488d0-4987-4bac-b19e-95aea0c0770a'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:37:08.271534 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf4eda0a-8f5f-46f3-ba6e-0329c0495416 tempest-GroupsV314Test-1796893369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:08.318291 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cf4eda0a-8f5f-46f3-ba6e-0329c0495416 tempest-GroupsV314Test-1796893369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:08.359744 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-cf4eda0a-8f5f-46f3-ba6e-0329c0495416 tempest-GroupsV314Test-1796893369 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:37:08.367764 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cf4eda0a-8f5f-46f3-ba6e-0329c0495416 tempest-GroupsV314Test-1796893369 None] Delete group completed successfully.
Apr 16 21:37:09.177198 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-279c410a-8c4a-4504-8bf6-efa9eba20253 tempest-GroupsV314Test-1796893369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:09.327827 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-279c410a-8c4a-4504-8bf6-efa9eba20253 tempest-GroupsV314Test-1796893369 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:37:09.328308 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-279c410a-8c4a-4504-8bf6-efa9eba20253 tempest-GroupsV314Test-1796893369 None] Volume volume-c7a9af68-5c2a-4f5e-8ee0-ce482c957778 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:37:09.380009 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-279c410a-8c4a-4504-8bf6-efa9eba20253 tempest-GroupsV314Test-1796893369 None] deleting rbd volume volume-c7a9af68-5c2a-4f5e-8ee0-ce482c957778 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:37:09.469311 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:37:09.491579 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Flow 'volume_create_manager' (b55805c6-e25d-449f-b0a0-68d091c0206b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:37:09.498753 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88eeeab-379c-4fcf-bdb4-e1fef02713df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:09.515666 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88eeeab-379c-4fcf-bdb4-e1fef02713df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-81549213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b34f2bf6-18f5-4c91-b4f5-966981843552,host='ncdv-master-1@ceph#ceph',id=a624e41d-a4f1-4ed4-927a-049c790ca3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c51bc2236745d894d65a60227fff09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:37:09Z,use_quota=True,user_id='a5df433620994ea6891ffb0050f8b594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04855d89-2b20-47b6-b009-85bb7bcada8f),volume_type_id=04855d89-2b20-47b6-b009-85bb7bcada8f)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:09.521743 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a1ed4e6-68e2-4042-844c-a07264a8ce27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:09.526667 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a1ed4e6-68e2-4042-844c-a07264a8ce27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:09.531816 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64621bd-2e19-4e92-b83f-48e12dd62223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:09.536046 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64621bd-2e19-4e92-b83f-48e12dd62223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a624e41d-a4f1-4ed4-927a-049c790ca3ac', 'volume_name': 'volume-a624e41d-a4f1-4ed4-927a-049c790ca3ac', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:09.541218 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7552391c-cb22-493b-b1cc-9f5cb499ecb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:09.545262 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7552391c-cb22-493b-b1cc-9f5cb499ecb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:09.551506 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0dc234e-04fb-4f4d-9ace-21775ffed894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:09.551899 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Volume a624e41d-a4f1-4ed4-927a-049c790ca3ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a624e41d-a4f1-4ed4-927a-049c790ca3ac', 'volume_size': 1}
Apr 16 21:37:09.552323 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] creating volume 'volume-a624e41d-a4f1-4ed4-927a-049c790ca3ac' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:37:09.553112 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:10.489251 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:37:10.489812 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:37:10.493664 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0dc234e-04fb-4f4d-9ace-21775ffed894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a624e41d-a4f1-4ed4-927a-049c790ca3ac', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:10.498582 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862c78d2-1dd5-4e1a-8412-66859d1a3297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:10.558490 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:37:10.578051 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Flow 'volume_create_manager' (ecb7b47d-3da7-4b80-b948-ab70a7074c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:37:10.584487 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca5a291-4da6-4b1d-81a1-8972564d84a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:10.591077 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Volume volume-a624e41d-a4f1-4ed4-927a-049c790ca3ac (a624e41d-a4f1-4ed4-927a-049c790ca3ac): created successfully
Apr 16 21:37:10.594828 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862c78d2-1dd5-4e1a-8412-66859d1a3297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:10.600440 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Flow 'volume_create_manager' (b55805c6-e25d-449f-b0a0-68d091c0206b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:37:10.616148 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca5a291-4da6-4b1d-81a1-8972564d84a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-502453647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=20a35b0f-1aca-46a1-9358-2152659017e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce8058d50654dec85b438d71e0f6680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:37:10Z,use_quota=True,user_id='f51e82f52cfc4d758139246d4d64f6a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:10.621690 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95e5059-5483-4fa2-9fed-fd8e96bdaf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:10.625911 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95e5059-5483-4fa2-9fed-fd8e96bdaf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:10.631148 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2e9c7d-8567-4a4c-8ee9-21b558f76dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:10.635270 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2e9c7d-8567-4a4c-8ee9-21b558f76dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a35b0f-1aca-46a1-9358-2152659017e8', 'volume_name': 'volume-20a35b0f-1aca-46a1-9358-2152659017e8', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:10.640264 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2411853b-97a9-474f-8095-46d9c36a899f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:10.644442 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2411853b-97a9-474f-8095-46d9c36a899f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:10.649854 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c0155b-e40b-44fa-a24a-49f84704e8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:10.650956 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Volume 20a35b0f-1aca-46a1-9358-2152659017e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a35b0f-1aca-46a1-9358-2152659017e8', 'volume_size': 1}
Apr 16 21:37:10.651348 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] creating volume 'volume-20a35b0f-1aca-46a1-9358-2152659017e8' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:37:10.652068 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:10.693243 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-29053d31-4fe7-4686-a504-375fff253cae tempest-GroupsTest-26708387 None] Created volume successfully.
Apr 16 21:37:11.480205 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:37:11.480632 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:37:11.484530 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c0155b-e40b-44fa-a24a-49f84704e8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a35b0f-1aca-46a1-9358-2152659017e8', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:11.489218 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f746982-592b-411f-b6fd-6a674059ed35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:11.540036 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Volume volume-20a35b0f-1aca-46a1-9358-2152659017e8 (20a35b0f-1aca-46a1-9358-2152659017e8): created successfully
Apr 16 21:37:11.543855 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f746982-592b-411f-b6fd-6a674059ed35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:11.549493 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Flow 'volume_create_manager' (ecb7b47d-3da7-4b80-b948-ab70a7074c61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:37:11.640788 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-dcb8aba2-f2f4-4095-8750-0a84f929e59d tempest-AbsoluteLimitsTests-492517933 None] Created volume successfully.
Apr 16 21:37:12.255039 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:37:12.276140 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Flow 'volume_create_manager' (2ca7feed-403a-45a7-bb58-bc8892f68dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:37:12.285041 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45329ff-43b5-48a5-a07e-643916cca7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:12.300236 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45329ff-43b5-48a5-a07e-643916cca7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-560908012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b34f2bf6-18f5-4c91-b4f5-966981843552,host='ncdv-master-1@ceph#ceph',id=c9b76457-ac0f-4eac-9c4b-9ac84085d53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c51bc2236745d894d65a60227fff09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:37:12Z,use_quota=True,user_id='a5df433620994ea6891ffb0050f8b594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04855d89-2b20-47b6-b009-85bb7bcada8f),volume_type_id=04855d89-2b20-47b6-b009-85bb7bcada8f)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:12.305646 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68bf09a-4f45-4c59-9f9d-403682c23459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:12.309894 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68bf09a-4f45-4c59-9f9d-403682c23459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:12.315081 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc717ddf-f5fa-4605-b5ed-43f6a2c1ca6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:12.319148 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc717ddf-f5fa-4605-b5ed-43f6a2c1ca6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9b76457-ac0f-4eac-9c4b-9ac84085d53d', 'volume_name': 'volume-c9b76457-ac0f-4eac-9c4b-9ac84085d53d', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:12.324612 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead261df-d20f-42e3-8eb4-bb30e4e2b215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:12.328482 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead261df-d20f-42e3-8eb4-bb30e4e2b215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:12.333241 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84957bfb-9739-4e03-87bd-b4d047706098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:12.334341 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Volume c9b76457-ac0f-4eac-9c4b-9ac84085d53d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9b76457-ac0f-4eac-9c4b-9ac84085d53d', 'volume_size': 1}
Apr 16 21:37:12.334725 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] creating volume 'volume-c9b76457-ac0f-4eac-9c4b-9ac84085d53d' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:37:12.335428 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:12.697722 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9e237a66-77c7-432d-a781-787fea57ac8d tempest-AbsoluteLimitsTests-492517933 None] Lock "b'cinder-20a35b0f-1aca-46a1-9358-2152659017e8-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:37:12.771481 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9e237a66-77c7-432d-a781-787fea57ac8d tempest-AbsoluteLimitsTests-492517933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:13.001358 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9e237a66-77c7-432d-a781-787fea57ac8d tempest-AbsoluteLimitsTests-492517933 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:37:13.001690 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9e237a66-77c7-432d-a781-787fea57ac8d tempest-AbsoluteLimitsTests-492517933 None] Volume volume-20a35b0f-1aca-46a1-9358-2152659017e8 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:37:13.260882 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9e237a66-77c7-432d-a781-787fea57ac8d tempest-AbsoluteLimitsTests-492517933 None] deleting rbd volume volume-20a35b0f-1aca-46a1-9358-2152659017e8 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:37:13.270349 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:37:13.270720 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:37:13.275988 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84957bfb-9739-4e03-87bd-b4d047706098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9b76457-ac0f-4eac-9c4b-9ac84085d53d', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:13.281718 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16fc3711-b796-4494-a309-714eda8f9906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:13.373448 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Volume volume-c9b76457-ac0f-4eac-9c4b-9ac84085d53d (c9b76457-ac0f-4eac-9c4b-9ac84085d53d): created successfully
Apr 16 21:37:13.378034 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16fc3711-b796-4494-a309-714eda8f9906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:13.383673 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Flow 'volume_create_manager' (2ca7feed-403a-45a7-bb58-bc8892f68dbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:37:13.477588 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-119189ca-1b37-4137-be00-b11c533f72e5 tempest-GroupsTest-26708387 None] Created volume successfully.
Apr 16 21:37:14.031301 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-85993bbb-1515-4ff9-b064-0cf5233d1439 req-c3669e60-3ba1-4adf-b38d-83ea98fe5557 tempest-VolumesBackupsTest-493584864 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:37:14.180214 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-279c410a-8c4a-4504-8bf6-efa9eba20253 tempest-GroupsV314Test-1796893369 None] Created reservations ['ce0e8a5c-055d-49b1-9875-a5684c508fb1'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:37:14.260143 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-279c410a-8c4a-4504-8bf6-efa9eba20253 tempest-GroupsV314Test-1796893369 None] Created reservations ['55c45b9b-4dc1-457e-8a15-0377ec257f04', 'd3cc788d-6413-4864-b2ac-26740bfbb9b0', 'bd82aae1-8aba-4d35-b186-225f9b29a437', '25e0f64c-be07-4f6b-9507-eeec5266b12e'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:37:14.517209 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-528d5757-92e3-4334-8e15-a30a06f34f09 tempest-GroupsTest-26708387 None] Update group completed successfully.
Apr 16 21:37:14.714806 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-279c410a-8c4a-4504-8bf6-efa9eba20253 tempest-GroupsV314Test-1796893369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:14.740299 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-279c410a-8c4a-4504-8bf6-efa9eba20253 tempest-GroupsV314Test-1796893369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:14.768340 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-279c410a-8c4a-4504-8bf6-efa9eba20253 tempest-GroupsV314Test-1796893369 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:37:14.771138 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-85993bbb-1515-4ff9-b064-0cf5233d1439 req-c3669e60-3ba1-4adf-b38d-83ea98fe5557 tempest-VolumesBackupsTest-493584864 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.740s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:37:14.771827 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-85993bbb-1515-4ff9-b064-0cf5233d1439 req-c3669e60-3ba1-4adf-b38d-83ea98fe5557 tempest-VolumesBackupsTest-493584864 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:37:14.776378 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-279c410a-8c4a-4504-8bf6-efa9eba20253 tempest-GroupsV314Test-1796893369 None] Delete group completed successfully.
Apr 16 21:37:14.870976 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-85993bbb-1515-4ff9-b064-0cf5233d1439 req-c3669e60-3ba1-4adf-b38d-83ea98fe5557 tempest-VolumesBackupsTest-493584864 None] Connection info returned from driver {'name': 'volumes/volume-0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '23573936-0c78-493d-a7ec-b7cc45e3195c'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:37:14.988242 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-85993bbb-1515-4ff9-b064-0cf5233d1439 req-c3669e60-3ba1-4adf-b38d-83ea98fe5557 tempest-VolumesBackupsTest-493584864 None] attachment_update completed successfully.
Apr 16 21:37:15.853868 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-35d74ed1-35d0-4694-8d7c-cc731f06fbec tempest-GroupsTest-26708387 None] Update group completed successfully.
Apr 16 21:37:17.293932 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-9e237a66-77c7-432d-a781-787fea57ac8d tempest-AbsoluteLimitsTests-492517933 None] Created reservations ['995585b6-8654-4d52-b899-647f22c466bb', '504bec05-06d3-4a71-8ca3-5893a7a8efa2', 'be79b0ed-c681-47f0-be26-2bd70db3b444', '1b8094e9-fbae-436e-b002-faa5189cabc1'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:37:17.432129 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c509357c-fc29-4c6d-ad61-84a2119f7087 tempest-GroupsTest-26708387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:17.561811 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c509357c-fc29-4c6d-ad61-84a2119f7087 tempest-GroupsTest-26708387 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:37:17.562538 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c509357c-fc29-4c6d-ad61-84a2119f7087 tempest-GroupsTest-26708387 None] Volume volume-a624e41d-a4f1-4ed4-927a-049c790ca3ac is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:37:17.649064 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c509357c-fc29-4c6d-ad61-84a2119f7087 tempest-GroupsTest-26708387 None] deleting rbd volume volume-a624e41d-a4f1-4ed4-927a-049c790ca3ac {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:37:17.739525 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9e237a66-77c7-432d-a781-787fea57ac8d tempest-AbsoluteLimitsTests-492517933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:17.769917 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9e237a66-77c7-432d-a781-787fea57ac8d tempest-AbsoluteLimitsTests-492517933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:17.796090 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-9e237a66-77c7-432d-a781-787fea57ac8d tempest-AbsoluteLimitsTests-492517933 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:37:17.799958 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9e237a66-77c7-432d-a781-787fea57ac8d tempest-AbsoluteLimitsTests-492517933 None] Deleted volume successfully.
Apr 16 21:37:17.875204 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9e237a66-77c7-432d-a781-787fea57ac8d tempest-AbsoluteLimitsTests-492517933 None] Lock "b'cinder-20a35b0f-1aca-46a1-9358-2152659017e8-delete_volume'" released by "delete_volume" :: held 5.177s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:37:18.984116 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6d6b2bbc-f07d-454b-a500-f68b157c0071 tempest-VolumesBackupsTest-493584864 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-16T21:37:18Z,data_timestamp=2022-04-16T21:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1035261800',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=8e05f40b-c063-449b-8140-ed75064781b3,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d51b576f9c0241c1a254f15308a455ec',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='77f61ccbf5114e6080e33f0c5f500468',volume_id=0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861)
Apr 16 21:37:18.987808 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.backup.rpcapi [None req-6d6b2bbc-f07d-454b-a500-f68b157c0071 tempest-VolumesBackupsTest-493584864 None] continue_backup in rpcapi backup_id 8e05f40b-c063-449b-8140-ed75064781b3 {{(pid=130674) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Apr 16 21:37:19.123337 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-6d6b2bbc-f07d-454b-a500-f68b157c0071 tempest-VolumesBackupsTest-493584864 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:37:19.800740 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-6d6b2bbc-f07d-454b-a500-f68b157c0071 tempest-VolumesBackupsTest-493584864 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.677s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:37:19.807049 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6d6b2bbc-f07d-454b-a500-f68b157c0071 tempest-VolumesBackupsTest-493584864 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:37:19.814746 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6d6b2bbc-f07d-454b-a500-f68b157c0071 tempest-VolumesBackupsTest-493584864 None] Initialize volume connection completed successfully.
Apr 16 21:37:21.353381 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c509357c-fc29-4c6d-ad61-84a2119f7087 tempest-GroupsTest-26708387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:21.520705 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c509357c-fc29-4c6d-ad61-84a2119f7087 tempest-GroupsTest-26708387 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:37:21.521163 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c509357c-fc29-4c6d-ad61-84a2119f7087 tempest-GroupsTest-26708387 None] Volume volume-c9b76457-ac0f-4eac-9c4b-9ac84085d53d is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:37:21.773995 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c509357c-fc29-4c6d-ad61-84a2119f7087 tempest-GroupsTest-26708387 None] deleting rbd volume volume-c9b76457-ac0f-4eac-9c4b-9ac84085d53d {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:37:22.894389 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:37:22.916745 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Flow 'volume_create_manager' (97500619-dadc-487c-a23b-d9dddca5efef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:37:22.923553 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f283ed-518c-4fd7-8ab1-6dcbedc12748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:22.943174 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f283ed-518c-4fd7-8ab1-6dcbedc12748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-551503394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fd4712dc-4c73-42d6-8e06-1e0c0454eb5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777f68cebdfa4838884858b53fd6241e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:37:23Z,use_quota=True,user_id='37d9ae4bb5e14b84bc7f28f94f910763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:22.950942 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7965ecf9-6fce-4652-b30a-565cb031e7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:22.955727 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7965ecf9-6fce-4652-b30a-565cb031e7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:22.963097 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a265657-6d99-42ea-967a-53a688db89a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:22.967718 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a265657-6d99-42ea-967a-53a688db89a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd4712dc-4c73-42d6-8e06-1e0c0454eb5c', 'volume_name': 'volume-fd4712dc-4c73-42d6-8e06-1e0c0454eb5c', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:22.974719 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09003b7-b1df-4945-af8a-c9a4bdbcadec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:22.978627 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09003b7-b1df-4945-af8a-c9a4bdbcadec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:22.983434 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2708c75-aca8-4397-908c-9a357a641392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:22.984601 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Volume fd4712dc-4c73-42d6-8e06-1e0c0454eb5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd4712dc-4c73-42d6-8e06-1e0c0454eb5c', 'volume_size': 1}
Apr 16 21:37:22.990530 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] creating volume 'volume-fd4712dc-4c73-42d6-8e06-1e0c0454eb5c' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:37:22.990530 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:23.735871 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:37:23.736310 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:37:23.740091 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2708c75-aca8-4397-908c-9a357a641392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd4712dc-4c73-42d6-8e06-1e0c0454eb5c', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:23.745551 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3caf10ce-7409-421b-98fd-e3ab9e3d816f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:23.801686 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Volume volume-fd4712dc-4c73-42d6-8e06-1e0c0454eb5c (fd4712dc-4c73-42d6-8e06-1e0c0454eb5c): created successfully
Apr 16 21:37:23.806119 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3caf10ce-7409-421b-98fd-e3ab9e3d816f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:23.811735 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Flow 'volume_create_manager' (97500619-dadc-487c-a23b-d9dddca5efef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:37:23.869918 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6017db8f-39d1-45ad-9526-140ced717075 tempest-VolumeQuotasAdminTestJSON-737702940 None] Created volume successfully.
Apr 16 21:37:25.182107 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3f96c04c-e217-4f5c-9266-08c51ccc1ba7 tempest-VolumeQuotasAdminTestJSON-737702940 None] Lock "b'cinder-fd4712dc-4c73-42d6-8e06-1e0c0454eb5c-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:37:25.278777 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3f96c04c-e217-4f5c-9266-08c51ccc1ba7 tempest-VolumeQuotasAdminTestJSON-737702940 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:25.510359 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3f96c04c-e217-4f5c-9266-08c51ccc1ba7 tempest-VolumeQuotasAdminTestJSON-737702940 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:37:25.510692 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3f96c04c-e217-4f5c-9266-08c51ccc1ba7 tempest-VolumeQuotasAdminTestJSON-737702940 None] Volume volume-fd4712dc-4c73-42d6-8e06-1e0c0454eb5c is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:37:25.729055 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3f96c04c-e217-4f5c-9266-08c51ccc1ba7 tempest-VolumeQuotasAdminTestJSON-737702940 None] deleting rbd volume volume-fd4712dc-4c73-42d6-8e06-1e0c0454eb5c {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:37:26.885237 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6d6b2bbc-f07d-454b-a500-f68b157c0071 tempest-VolumesBackupsTest-493584864 None] Terminate volume connection completed successfully.
Apr 16 21:37:26.906804 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6d6b2bbc-f07d-454b-a500-f68b157c0071 tempest-VolumesBackupsTest-493584864 None] Remove volume export completed successfully.
Apr 16 21:37:28.335672 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-c509357c-fc29-4c6d-ad61-84a2119f7087 tempest-GroupsTest-26708387 None] Created reservations ['e2688b53-b551-46cc-9fc8-b5ff3d0a3522'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:37:28.355895 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-c509357c-fc29-4c6d-ad61-84a2119f7087 tempest-GroupsTest-26708387 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-45023762 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-45023762, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:37:28.355895 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-c509357c-fc29-4c6d-ad61-84a2119f7087 tempest-GroupsTest-26708387 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-45023762 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-45023762, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:37:28.442275 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-c509357c-fc29-4c6d-ad61-84a2119f7087 tempest-GroupsTest-26708387 None] Created reservations ['b4621461-07b8-4835-8148-2cf84423f76d', '5d7cf77e-3544-4879-8881-58688b3987e0', '76a75181-e22c-4600-8e6c-bbc58fc069a2', '1da21a43-3f3c-4f44-b2cf-7caf461871ec'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:37:28.617497 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:37:28.619308 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:28.648069 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:28.684500 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:37:28.847899 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-c509357c-fc29-4c6d-ad61-84a2119f7087 tempest-GroupsTest-26708387 None] Created reservations ['dbaf8574-41d1-4654-a627-48f4cbc943bb', 'f6989258-10cd-40ec-b60f-56926b87245a', '3015d1ba-6f86-4288-9949-913e00f6e982', '74c40d4c-a2f9-42b0-b677-99d8b5f67c52'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:37:29.278857 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c509357c-fc29-4c6d-ad61-84a2119f7087 tempest-GroupsTest-26708387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:29.386925 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c509357c-fc29-4c6d-ad61-84a2119f7087 tempest-GroupsTest-26708387 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:29.453163 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-c509357c-fc29-4c6d-ad61-84a2119f7087 tempest-GroupsTest-26708387 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:37:29.466174 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c509357c-fc29-4c6d-ad61-84a2119f7087 tempest-GroupsTest-26708387 None] Delete group completed successfully.
Apr 16 21:37:32.287050 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-3f96c04c-e217-4f5c-9266-08c51ccc1ba7 tempest-VolumeQuotasAdminTestJSON-737702940 None] Created reservations ['544dc01d-a260-4729-8584-57a59d89cc5f', '6d264742-edb2-4285-8888-100f03112965', '2633345e-1c7e-4568-b068-2bb46dbdf608', 'ba406250-e97d-4722-9100-7a7336a578d3'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:37:32.515183 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3f96c04c-e217-4f5c-9266-08c51ccc1ba7 tempest-VolumeQuotasAdminTestJSON-737702940 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:32.539592 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3f96c04c-e217-4f5c-9266-08c51ccc1ba7 tempest-VolumeQuotasAdminTestJSON-737702940 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:32.606558 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-3f96c04c-e217-4f5c-9266-08c51ccc1ba7 tempest-VolumeQuotasAdminTestJSON-737702940 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:37:32.621274 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3f96c04c-e217-4f5c-9266-08c51ccc1ba7 tempest-VolumeQuotasAdminTestJSON-737702940 None] Deleted volume successfully.
Apr 16 21:37:32.713191 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3f96c04c-e217-4f5c-9266-08c51ccc1ba7 tempest-VolumeQuotasAdminTestJSON-737702940 None] Lock "b'cinder-fd4712dc-4c73-42d6-8e06-1e0c0454eb5c-delete_volume'" released by "delete_volume" :: held 7.531s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:37:33.505825 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:37:33.526394 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Flow 'volume_create_manager' (c3279f59-8abb-4e45-9eda-a5709288b772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:37:33.533605 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e00aa8-ea4f-4a15-98dc-bdacfdeb2086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:33.549007 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e00aa8-ea4f-4a15-98dc-bdacfdeb2086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1176874132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=75d1ad54-c891-4c7d-b648-2f25fefb463b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777f68cebdfa4838884858b53fd6241e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:37:33Z,use_quota=True,user_id='37d9ae4bb5e14b84bc7f28f94f910763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:33.555114 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ce8d3d-3b0f-42f6-aae3-fa2e450882a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:33.562352 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ce8d3d-3b0f-42f6-aae3-fa2e450882a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:33.573840 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf7fbec-d9ea-4282-b84d-af35bae6e169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:33.578555 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf7fbec-d9ea-4282-b84d-af35bae6e169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d1ad54-c891-4c7d-b648-2f25fefb463b', 'volume_name': 'volume-75d1ad54-c891-4c7d-b648-2f25fefb463b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:33.584672 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9423b68-3682-4bdc-ad83-1fc8f27586ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:33.589126 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9423b68-3682-4bdc-ad83-1fc8f27586ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:33.594224 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29563a4-c79a-4589-8c08-b7a568535a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:33.595693 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Volume 75d1ad54-c891-4c7d-b648-2f25fefb463b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d1ad54-c891-4c7d-b648-2f25fefb463b', 'volume_size': 1}
Apr 16 21:37:33.596424 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] creating volume 'volume-75d1ad54-c891-4c7d-b648-2f25fefb463b' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:37:33.597406 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:34.655843 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:37:34.656591 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:37:34.660241 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29563a4-c79a-4589-8c08-b7a568535a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d1ad54-c891-4c7d-b648-2f25fefb463b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:34.665795 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e53dfa-1934-4af1-bf06-bd8a45a87296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:34.800767 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Volume volume-75d1ad54-c891-4c7d-b648-2f25fefb463b (75d1ad54-c891-4c7d-b648-2f25fefb463b): created successfully
Apr 16 21:37:34.804392 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e53dfa-1934-4af1-bf06-bd8a45a87296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:34.810269 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Flow 'volume_create_manager' (c3279f59-8abb-4e45-9eda-a5709288b772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:37:34.938161 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0c8481da-504f-493d-8b2e-a210f01a4449 tempest-VolumeQuotasAdminTestJSON-737702940 None] Created volume successfully.
Apr 16 21:37:35.499207 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:37:35.519375 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Flow 'volume_create_manager' (8e9c678e-86bd-4a29-8725-54fc5b9bcbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:37:35.525961 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a5962c-0caa-45ca-a92e-b9ebee468c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:35.541391 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a5962c-0caa-45ca-a92e-b9ebee468c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1360236012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=702b1d25-8267-4f44-8270-b34d39961e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f91f70b9d443f4a87d649d49745cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:37:35Z,use_quota=True,user_id='c9c8a069c11a4f3296195fa03554a556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:35.547703 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441a3548-01ba-45b0-97d2-02c087f8190d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:35.552064 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441a3548-01ba-45b0-97d2-02c087f8190d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:35.561794 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8164adae-3fa3-4844-8af1-a9f18244d807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:35.563260 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8164adae-3fa3-4844-8af1-a9f18244d807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '702b1d25-8267-4f44-8270-b34d39961e68', 'volume_name': 'volume-702b1d25-8267-4f44-8270-b34d39961e68', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:35.568684 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20e3445-4958-4712-bce8-fa2e65fdf68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:35.572804 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20e3445-4958-4712-bce8-fa2e65fdf68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:35.577786 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38657f4f-a0d3-45db-9f34-eb6bca063737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:35.578908 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Volume 702b1d25-8267-4f44-8270-b34d39961e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-702b1d25-8267-4f44-8270-b34d39961e68', 'volume_size': 1}
Apr 16 21:37:35.579306 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] creating volume 'volume-702b1d25-8267-4f44-8270-b34d39961e68' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:37:35.579974 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:36.220870 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:37:36.221468 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:37:36.225070 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38657f4f-a0d3-45db-9f34-eb6bca063737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-702b1d25-8267-4f44-8270-b34d39961e68', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:36.229637 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41d92e0-7d06-483e-8c4f-39e8bd448012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:36.303519 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Volume volume-702b1d25-8267-4f44-8270-b34d39961e68 (702b1d25-8267-4f44-8270-b34d39961e68): created successfully
Apr 16 21:37:36.307196 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41d92e0-7d06-483e-8c4f-39e8bd448012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:36.313508 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Flow 'volume_create_manager' (8e9c678e-86bd-4a29-8725-54fc5b9bcbb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:37:36.406607 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4f95fc29-bd95-41a0-9120-404f009b5b0e tempest-SnapshotsActionsTest-888445623 None] Created volume successfully.
Apr 16 21:37:36.713922 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8f7af201-b209-4b64-90de-fc26182d6bdd tempest-VolumeQuotasAdminTestJSON-493708051 None] Transfer volume completed successfully.
Apr 16 21:37:38.018179 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8e023f20-314d-4295-ab12-ab705d4b539a tempest-VolumeQuotasAdminTestJSON-1217052301 None] Lock "b'cinder-75d1ad54-c891-4c7d-b648-2f25fefb463b-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:37:38.176898 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8e023f20-314d-4295-ab12-ab705d4b539a tempest-VolumeQuotasAdminTestJSON-1217052301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:38.371996 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8e023f20-314d-4295-ab12-ab705d4b539a tempest-VolumeQuotasAdminTestJSON-1217052301 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:37:38.372712 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8e023f20-314d-4295-ab12-ab705d4b539a tempest-VolumeQuotasAdminTestJSON-1217052301 None] Volume volume-75d1ad54-c891-4c7d-b648-2f25fefb463b is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:37:38.595557 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8e023f20-314d-4295-ab12-ab705d4b539a tempest-VolumeQuotasAdminTestJSON-1217052301 None] deleting rbd volume volume-75d1ad54-c891-4c7d-b648-2f25fefb463b {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:37:38.615519 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-55258af9-349a-41ba-98ad-29ad27b93018 tempest-SnapshotsActionsTest-888445623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:38.875491 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-0126b064-9d5b-4bb0-ae87-4f8f76483fc1 req-3dd4e650-ccf3-4bed-8d48-02a639fc51db tempest-VolumesBackupsTest-493584864 None] Terminate volume connection completed successfully.
Apr 16 21:37:38.875919 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-0126b064-9d5b-4bb0-ae87-4f8f76483fc1 req-3dd4e650-ccf3-4bed-8d48-02a639fc51db tempest-VolumesBackupsTest-493584864 None] Deleting attachment 23573936-0c78-493d-a7ec-b7cc45e3195c. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:37:42.496941 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-55258af9-349a-41ba-98ad-29ad27b93018 tempest-SnapshotsActionsTest-888445623 None] Create snapshot completed successfully
Apr 16 21:37:43.517377 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-8e023f20-314d-4295-ab12-ab705d4b539a tempest-VolumeQuotasAdminTestJSON-1217052301 None] Created reservations ['58598f45-bae3-4087-a88d-67b9ba345de0', '6b258cce-f903-4bb9-9ba1-2dce3f4c6332', 'ffb7c26e-68aa-4e45-acd0-c86ecd9aaf59', 'f190d52f-1a1e-4566-95d6-35c0eb9bc61c'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:37:43.699617 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8e023f20-314d-4295-ab12-ab705d4b539a tempest-VolumeQuotasAdminTestJSON-1217052301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:43.773273 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8e023f20-314d-4295-ab12-ab705d4b539a tempest-VolumeQuotasAdminTestJSON-1217052301 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:43.814078 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8e023f20-314d-4295-ab12-ab705d4b539a tempest-VolumeQuotasAdminTestJSON-1217052301 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:37:43.829749 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8e023f20-314d-4295-ab12-ab705d4b539a tempest-VolumeQuotasAdminTestJSON-1217052301 None] Deleted volume successfully.
Apr 16 21:37:43.843157 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9a4af442-6d65-4bc7-a17a-bf184815143d tempest-VolumesBackupsTest-493584864 None] Lock "b'cinder-0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:37:43.926148 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8e023f20-314d-4295-ab12-ab705d4b539a tempest-VolumeQuotasAdminTestJSON-1217052301 None] Lock "b'cinder-75d1ad54-c891-4c7d-b648-2f25fefb463b-delete_volume'" released by "delete_volume" :: held 5.908s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:37:44.031522 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9a4af442-6d65-4bc7-a17a-bf184815143d tempest-VolumesBackupsTest-493584864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:45.690925 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9a4af442-6d65-4bc7-a17a-bf184815143d tempest-VolumesBackupsTest-493584864 None] Volume volume-0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:37:46.012093 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9a4af442-6d65-4bc7-a17a-bf184815143d tempest-VolumesBackupsTest-493584864 None] deleting rbd volume volume-0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:37:46.105821 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5ef7594a-332c-45ae-adbb-f0c538df7694 tempest-SnapshotsActionsTest-888445623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:50.143364 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5ef7594a-332c-45ae-adbb-f0c538df7694 tempest-SnapshotsActionsTest-888445623 None] Create snapshot completed successfully
Apr 16 21:37:50.905362 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-fe02c713-4cfb-44b8-baaa-ed85d81136d1 tempest-SnapshotsActionsTest-1429847703 None] Lock "b'cinder-c86b3934-8dc2-44c8-af73-d4ec5cf7bc5c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:37:50.906954 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fe02c713-4cfb-44b8-baaa-ed85d81136d1 tempest-SnapshotsActionsTest-1429847703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:51.152652 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:37:51.183700 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Flow 'volume_create_manager' (10c9ea8b-e987-4561-a047-ed0780099485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:37:51.190854 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c438d7-d479-48fb-aa31-e3d8e7c6f69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:51.210111 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c438d7-d479-48fb-aa31-e3d8e7c6f69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-685709471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2a52b0c3-1018-488f-bff4-8d3025861720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80715ea8284b48959a67d33e8be6b560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:37:51Z,use_quota=True,user_id='52bbf82f2ac64a4c9e3b86975f8173b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:51.215800 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37c17a8-8a28-4980-8cb5-ef7517cc43ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:51.220472 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37c17a8-8a28-4980-8cb5-ef7517cc43ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:51.226490 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19716099-e644-4dba-81d0-6bc6cc388727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:51.336374 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19716099-e644-4dba-81d0-6bc6cc388727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a52b0c3-1018-488f-bff4-8d3025861720', 'volume_name': 'volume-2a52b0c3-1018-488f-bff4-8d3025861720', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7125bc6d0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:51.340112 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5f900c-3f31-4a62-b4ee-d92d52ad88a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:51.344503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5f900c-3f31-4a62-b4ee-d92d52ad88a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:51.350197 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89635228-5b59-483a-afd2-5f59691ee999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:51.352267 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Volume 2a52b0c3-1018-488f-bff4-8d3025861720: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a52b0c3-1018-488f-bff4-8d3025861720', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7125bc6d0>}
Apr 16 21:37:51.353387 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Cloning 2a52b0c3-1018-488f-bff4-8d3025861720 from image 88bbe9a7-19d2-4102-9634-058b7c590848  at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 16 21:37:51.376492 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:37:51.468711 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 37, 51, 368160)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:37:51.469380 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:37:51.470098 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Found cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 16 21:37:51.474829 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" released by "_prepare_image_cache_entry" :: held 0.111s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:37:51.475917 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Attempting to retrieve cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 16 21:37:51.482728 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 37, 51, 480218)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:37:51.483151 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:37:51.483582 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Creating from source image-volume e0e222dd-75a5-4728-81e0-d352ad2a6247 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 16 21:37:51.505358 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:51.747885 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] creating snapshot='volume-2a52b0c3-1018-488f-bff4-8d3025861720.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:37:52.795220 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] cloning 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247@volume-2a52b0c3-1018-488f-bff4-8d3025861720.clone_snap' to 'volume-2a52b0c3-1018-488f-bff4-8d3025861720' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:37:52.913258 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-9a4af442-6d65-4bc7-a17a-bf184815143d tempest-VolumesBackupsTest-493584864 None] Created reservations ['626b0cf3-63c5-4e85-be53-338f3d7a757d', '5330bd6a-e541-472a-9704-6e11e9df9ae0', '4b11f36a-8a69-4017-9941-2f1d6b45a601', 'ea927acf-e88a-4837-8dc7-82ca779ac34a'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:37:53.092523 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9a4af442-6d65-4bc7-a17a-bf184815143d tempest-VolumesBackupsTest-493584864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:53.177942 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9a4af442-6d65-4bc7-a17a-bf184815143d tempest-VolumesBackupsTest-493584864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:53.205751 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-9a4af442-6d65-4bc7-a17a-bf184815143d tempest-VolumesBackupsTest-493584864 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:37:53.211141 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9a4af442-6d65-4bc7-a17a-bf184815143d tempest-VolumesBackupsTest-493584864 None] Deleted volume successfully.
Apr 16 21:37:53.275912 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9a4af442-6d65-4bc7-a17a-bf184815143d tempest-VolumesBackupsTest-493584864 None] Lock "b'cinder-0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861-delete_volume'" released by "delete_volume" :: held 9.430s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:37:53.545154 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:37:53.592825 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Flow 'volume_create_manager' (e91c8e1f-98df-4707-a6c8-d8d955cd1042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:37:53.592825 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b404dd8-1dad-4e39-aac2-d76c72849702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:53.607601 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b404dd8-1dad-4e39-aac2-d76c72849702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1246047891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a1ef4841-bfe9-4b69-9d20-119b8d59cf63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3216d6f8aa484fda9e751da151af598c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:37:53Z,use_quota=True,user_id='6fb9d5b7c2e149d597491c1223ff5dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:53.619353 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca409de-8f2a-45be-940d-8ed4f55e4774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:53.624161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca409de-8f2a-45be-940d-8ed4f55e4774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:53.629992 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f02df4e-908d-4c91-a4e9-b944f4fa8f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:53.634633 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f02df4e-908d-4c91-a4e9-b944f4fa8f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1ef4841-bfe9-4b69-9d20-119b8d59cf63', 'volume_name': 'volume-a1ef4841-bfe9-4b69-9d20-119b8d59cf63', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:53.639997 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (810b8c05-e578-40ae-9da9-8105ea201427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:53.644413 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (810b8c05-e578-40ae-9da9-8105ea201427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:53.651101 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2287d69-d24f-4e4c-b8a0-1a08fff90b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:53.652291 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Volume a1ef4841-bfe9-4b69-9d20-119b8d59cf63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1ef4841-bfe9-4b69-9d20-119b8d59cf63', 'volume_size': 1}
Apr 16 21:37:53.652597 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] creating volume 'volume-a1ef4841-bfe9-4b69-9d20-119b8d59cf63' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:37:53.653742 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:54.740641 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:37:54.741633 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:37:54.745182 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2287d69-d24f-4e4c-b8a0-1a08fff90b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1ef4841-bfe9-4b69-9d20-119b8d59cf63', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:54.754900 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1698325d-b432-44ac-9a17-6463c3fc2e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:54.773581 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:37:54.801819 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Flow 'volume_create_manager' (ea47d421-cbf3-4a66-a00a-c9eab110808e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:37:54.815828 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46cf3ee4-4073-4c23-aab9-f942610447f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:54.829399 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46cf3ee4-4073-4c23-aab9-f942610447f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1616208525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=46ed5edf-8b2e-4f49-a9bc-d26d3e657685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51b576f9c0241c1a254f15308a455ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:37:55Z,use_quota=True,user_id='77f61ccbf5114e6080e33f0c5f500468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:54.835596 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef670098-9f98-4eb5-8625-90a924e48425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:54.840503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef670098-9f98-4eb5-8625-90a924e48425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:54.845906 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fa9d02-8c04-4f05-9a0f-3ff2e675238f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:54.857928 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Volume volume-a1ef4841-bfe9-4b69-9d20-119b8d59cf63 (a1ef4841-bfe9-4b69-9d20-119b8d59cf63): created successfully
Apr 16 21:37:54.863485 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1698325d-b432-44ac-9a17-6463c3fc2e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:54.870974 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Flow 'volume_create_manager' (e91c8e1f-98df-4707-a6c8-d8d955cd1042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:37:54.929405 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:37:54.930830 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:37:54.931208 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:37:55.656131 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:37:55.657011 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Marking volume 2a52b0c3-1018-488f-bff4-8d3025861720 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:37:55.668302 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-895e8ba9-2830-49ec-8b03-0a0af8d2aba8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Created volume successfully.
Apr 16 21:37:55.721675 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fa9d02-8c04-4f05-9a0f-3ff2e675238f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '46ed5edf-8b2e-4f49-a9bc-d26d3e657685', 'volume_name': 'volume-46ed5edf-8b2e-4f49-a9bc-d26d3e657685', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710b970a0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:55.727334 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b875c40-efbe-4ee3-8b58-4bf9466d2ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:55.731398 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b875c40-efbe-4ee3-8b58-4bf9466d2ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:55.736244 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdd1a06-0765-42e6-bebe-fcbf64e7197c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:55.737397 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Volume 46ed5edf-8b2e-4f49-a9bc-d26d3e657685: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-46ed5edf-8b2e-4f49-a9bc-d26d3e657685', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710b970a0>}
Apr 16 21:37:55.740984 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Cloning 46ed5edf-8b2e-4f49-a9bc-d26d3e657685 from image 88bbe9a7-19d2-4102-9634-058b7c590848  at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 16 21:37:55.746813 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:37:55.806062 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Copying metadata from image 88bbe9a7-19d2-4102-9634-058b7c590848 to 2a52b0c3-1018-488f-bff4-8d3025861720. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 16 21:37:55.806499 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Creating volume glance metadata for volume 2a52b0c3-1018-488f-bff4-8d3025861720 backed by image 88bbe9a7-19d2-4102-9634-058b7c590848 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 16 21:37:55.828893 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 37, 55, 750687)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:37:55.829313 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:37:55.829787 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Found cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 16 21:37:55.838036 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" released by "_prepare_image_cache_entry" :: held 0.091s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:37:55.838904 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Attempting to retrieve cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 16 21:37:55.847790 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 37, 55, 843124)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:37:55.848719 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:37:55.849111 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Creating from source image-volume e0e222dd-75a5-4728-81e0-d352ad2a6247 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 16 21:37:55.865155 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:56.090546 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] creating snapshot='volume-46ed5edf-8b2e-4f49-a9bc-d26d3e657685.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:37:57.971539 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] cloning 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247@volume-46ed5edf-8b2e-4f49-a9bc-d26d3e657685.clone_snap' to 'volume-46ed5edf-8b2e-4f49-a9bc-d26d3e657685' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:37:58.084097 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89635228-5b59-483a-afd2-5f59691ee999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a52b0c3-1018-488f-bff4-8d3025861720', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7125bc6d0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:58.089011 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9861d955-8e72-44d6-a7cb-de0fc8919135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:37:58.104116 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-fe02c713-4cfb-44b8-baaa-ed85d81136d1 tempest-SnapshotsActionsTest-1429847703 None] Created reservations ['5f68587c-a75d-4ed4-8f0e-541c8e178156', '5c8eec49-6057-4ff7-986d-fe312a020fca', '827ed229-d4a9-4f9f-b48a-1685682e063f', 'ba8f94ed-4fa1-4651-b5fc-2a9d82aa6bb0'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:37:58.124660 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24713b1e-d10a-470b-a4c9-04f08213752c tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:37:58.553742 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Volume volume-2a52b0c3-1018-488f-bff4-8d3025861720 (2a52b0c3-1018-488f-bff4-8d3025861720): created successfully
Apr 16 21:37:58.559157 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9861d955-8e72-44d6-a7cb-de0fc8919135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:37:58.574114 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Flow 'volume_create_manager' (10c9ea8b-e987-4561-a047-ed0780099485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:37:58.702274 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8a602693-88af-4ad8-add3-23d8b0a69cce tempest-TestVolumeBackupRestore-1675082881 None] Created volume successfully.
Apr 16 21:37:58.776221 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fe02c713-4cfb-44b8-baaa-ed85d81136d1 tempest-SnapshotsActionsTest-1429847703 None] Delete snapshot completed successfully.
Apr 16 21:37:58.786705 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-fe02c713-4cfb-44b8-baaa-ed85d81136d1 tempest-SnapshotsActionsTest-1429847703 None] Lock "b'cinder-c86b3934-8dc2-44c8-af73-d4ec5cf7bc5c-delete_snapshot'" released by "delete_snapshot" :: held 7.881s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:37:59.491525 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:37:59.492798 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:37:59.493250 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:37:59.962164 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:37:59.962814 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Marking volume 46ed5edf-8b2e-4f49-a9bc-d26d3e657685 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:38:00.101316 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Copying metadata from image 88bbe9a7-19d2-4102-9634-058b7c590848 to 46ed5edf-8b2e-4f49-a9bc-d26d3e657685. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 16 21:38:00.101711 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Creating volume glance metadata for volume 46ed5edf-8b2e-4f49-a9bc-d26d3e657685 backed by image 88bbe9a7-19d2-4102-9634-058b7c590848 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 16 21:38:00.119647 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c8b3e760-4eec-4d04-bf57-1b0b212994f0 tempest-TestVolumeBackupRestore-1675082881 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-16T21:37:59Z,data_timestamp=2022-04-16T21:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=ab06f9fe-c532-404f-b0e9-d1e0343b39c8,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='80715ea8284b48959a67d33e8be6b560',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='52bbf82f2ac64a4c9e3b86975f8173b2',volume_id=2a52b0c3-1018-488f-bff4-8d3025861720)
Apr 16 21:38:00.120358 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.backup.rpcapi [None req-c8b3e760-4eec-4d04-bf57-1b0b212994f0 tempest-TestVolumeBackupRestore-1675082881 None] continue_backup in rpcapi backup_id ab06f9fe-c532-404f-b0e9-d1e0343b39c8 {{(pid=130674) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Apr 16 21:38:00.173005 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6e69f0e8-8db6-4d8a-b953-f0707ea3de8d tempest-SnapshotsActionsTest-888445623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:00.357669 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-c8b3e760-4eec-4d04-bf57-1b0b212994f0 tempest-TestVolumeBackupRestore-1675082881 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:38:00.490018 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdd1a06-0765-42e6-bebe-fcbf64e7197c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46ed5edf-8b2e-4f49-a9bc-d26d3e657685', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710b970a0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:00.495089 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800c52a4-b4b1-4a01-99bb-ad9e14ed84a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:00.576630 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Volume volume-46ed5edf-8b2e-4f49-a9bc-d26d3e657685 (46ed5edf-8b2e-4f49-a9bc-d26d3e657685): created successfully
Apr 16 21:38:00.580721 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800c52a4-b4b1-4a01-99bb-ad9e14ed84a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:00.587174 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Flow 'volume_create_manager' (ea47d421-cbf3-4a66-a00a-c9eab110808e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:38:00.666862 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3e956a94-a665-44d3-9a15-42a54d428e34 tempest-VolumesBackupsTest-493584864 None] Created volume successfully.
Apr 16 21:38:01.044469 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-c8b3e760-4eec-4d04-bf57-1b0b212994f0 tempest-TestVolumeBackupRestore-1675082881 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.687s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:38:01.045186 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c8b3e760-4eec-4d04-bf57-1b0b212994f0 tempest-TestVolumeBackupRestore-1675082881 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2a52b0c3-1018-488f-bff4-8d3025861720', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '2a52b0c3-1018-488f-bff4-8d3025861720', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:38:01.059329 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c8b3e760-4eec-4d04-bf57-1b0b212994f0 tempest-TestVolumeBackupRestore-1675082881 None] Initialize volume connection completed successfully.
Apr 16 21:38:01.415631 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-24713b1e-d10a-470b-a4c9-04f08213752c tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Create snapshot completed successfully
Apr 16 21:38:01.667602 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cb2ef55b-4223-4da7-9fd0-1d3d20e5290b tempest-VolumesBackupsTest-493584864 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-16T21:38:01Z,data_timestamp=2022-04-16T21:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-961156290',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=9c0f0465-f3dc-45d2-801b-939c0d169abe,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d51b576f9c0241c1a254f15308a455ec',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='77f61ccbf5114e6080e33f0c5f500468',volume_id=46ed5edf-8b2e-4f49-a9bc-d26d3e657685)
Apr 16 21:38:01.668571 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.backup.rpcapi [None req-cb2ef55b-4223-4da7-9fd0-1d3d20e5290b tempest-VolumesBackupsTest-493584864 None] continue_backup in rpcapi backup_id 9c0f0465-f3dc-45d2-801b-939c0d169abe {{(pid=130674) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Apr 16 21:38:01.783248 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-cb2ef55b-4223-4da7-9fd0-1d3d20e5290b tempest-VolumesBackupsTest-493584864 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:38:02.432674 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-cb2ef55b-4223-4da7-9fd0-1d3d20e5290b tempest-VolumesBackupsTest-493584864 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.649s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:38:02.433746 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cb2ef55b-4223-4da7-9fd0-1d3d20e5290b tempest-VolumesBackupsTest-493584864 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-46ed5edf-8b2e-4f49-a9bc-d26d3e657685', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '46ed5edf-8b2e-4f49-a9bc-d26d3e657685', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:38:02.451526 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cb2ef55b-4223-4da7-9fd0-1d3d20e5290b tempest-VolumesBackupsTest-493584864 None] Initialize volume connection completed successfully.
Apr 16 21:38:03.087499 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-dd3ab3bc-1f73-40d2-bd46-9d597c48cb51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Lock "b'cinder-1c81cbe5-0a35-4d45-8d7a-754b0447b3dd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:38:03.089689 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dd3ab3bc-1f73-40d2-bd46-9d597c48cb51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:03.431823 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6e69f0e8-8db6-4d8a-b953-f0707ea3de8d tempest-SnapshotsActionsTest-888445623 None] Create snapshot completed successfully
Apr 16 21:38:04.219305 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3d351fef-100b-419e-ba22-90bce7a7dfb9 tempest-SnapshotsActionsTest-1429847703 None] Lock "b'cinder-d4f71e29-8c28-463b-8959-2a76e268a04a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:38:04.220847 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3d351fef-100b-419e-ba22-90bce7a7dfb9 tempest-SnapshotsActionsTest-1429847703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:07.675732 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-dd3ab3bc-1f73-40d2-bd46-9d597c48cb51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Created reservations ['d0fece01-fc00-4323-8123-c40b99f7cd4a', '0890324d-5c3f-4c7e-9953-1c7ee26c764a', 'c2d5dc43-c9cd-4001-936c-06a4425dc069', 'ffd585ba-c8d9-40e6-a1dd-6f0f5ee0fbb1'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:38:07.879794 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-dd3ab3bc-1f73-40d2-bd46-9d597c48cb51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Delete snapshot completed successfully.
Apr 16 21:38:07.885097 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-dd3ab3bc-1f73-40d2-bd46-9d597c48cb51 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Lock "b'cinder-1c81cbe5-0a35-4d45-8d7a-754b0447b3dd-delete_snapshot'" released by "delete_snapshot" :: held 4.798s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:38:08.454043 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-700b4b5e-b004-4052-8486-cd8b8b71b339 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Lock "b'cinder-a1ef4841-bfe9-4b69-9d20-119b8d59cf63-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:38:08.536423 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-700b4b5e-b004-4052-8486-cd8b8b71b339 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:09.023581 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-700b4b5e-b004-4052-8486-cd8b8b71b339 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:38:09.027497 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-700b4b5e-b004-4052-8486-cd8b8b71b339 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Volume volume-a1ef4841-bfe9-4b69-9d20-119b8d59cf63 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:38:09.542745 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-700b4b5e-b004-4052-8486-cd8b8b71b339 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] deleting rbd volume volume-a1ef4841-bfe9-4b69-9d20-119b8d59cf63 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:38:09.697701 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-3d351fef-100b-419e-ba22-90bce7a7dfb9 tempest-SnapshotsActionsTest-1429847703 None] Created reservations ['e5a65444-ebed-4ce1-8d1f-453eaa6b67bb', '36cae742-dc80-4996-af83-d564e9146f81', '65e06a2e-8b2f-403c-a5d7-257c95620beb', '2030168c-fd5e-4b02-9a52-66159ee7ce7a'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:38:09.940336 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3d351fef-100b-419e-ba22-90bce7a7dfb9 tempest-SnapshotsActionsTest-1429847703 None] Delete snapshot completed successfully.
Apr 16 21:38:09.943335 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3d351fef-100b-419e-ba22-90bce7a7dfb9 tempest-SnapshotsActionsTest-1429847703 None] Lock "b'cinder-d4f71e29-8c28-463b-8959-2a76e268a04a-delete_snapshot'" released by "delete_snapshot" :: held 5.724s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:38:11.280793 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ed23b274-44ee-4fd5-bf7f-68ea812983db tempest-SnapshotsActionsTest-888445623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:20.918177 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ed23b274-44ee-4fd5-bf7f-68ea812983db tempest-SnapshotsActionsTest-888445623 None] Create snapshot completed successfully
Apr 16 21:38:21.653814 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-73e7d518-b055-4298-869d-742ba7bf85b9 tempest-SnapshotsActionsTest-1429847703 None] Lock "b'cinder-6b4fcdfa-821e-4b9a-8e7f-e801ac58adee-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:38:21.655273 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-73e7d518-b055-4298-869d-742ba7bf85b9 tempest-SnapshotsActionsTest-1429847703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:25.369412 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-700b4b5e-b004-4052-8486-cd8b8b71b339 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Created reservations ['c3c692a9-caca-49ca-a2c4-d2fcef800b65', 'ec5e9eae-8447-4324-a8d3-8499548afb07', '6b4a99f3-91e3-4cfd-8db5-0339e21d152d', '90857df3-5a52-483f-8518-a1cad3fb89c2'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:38:25.587467 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-700b4b5e-b004-4052-8486-cd8b8b71b339 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:25.630748 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-700b4b5e-b004-4052-8486-cd8b8b71b339 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:25.688853 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-700b4b5e-b004-4052-8486-cd8b8b71b339 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:38:25.697842 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-700b4b5e-b004-4052-8486-cd8b8b71b339 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Deleted volume successfully.
Apr 16 21:38:25.842603 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-700b4b5e-b004-4052-8486-cd8b8b71b339 tempest-VolumeSnapshotQuotasNegativeTestJSON-1578068207 None] Lock "b'cinder-a1ef4841-bfe9-4b69-9d20-119b8d59cf63-delete_volume'" released by "delete_volume" :: held 17.388s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:38:28.519460 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8bf15cb5-0cfb-417b-bbc4-12dec46006f8 tempest-AttachVolumeShelveTestJSON-1483033820 None] Lock "b'cinder-5b6ddcce-64a6-4813-bff3-73c4e4ef81d6-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:38:28.622193 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:38:28.622927 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:28.650401 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:28.733494 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:38:28.762649 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8bf15cb5-0cfb-417b-bbc4-12dec46006f8 tempest-AttachVolumeShelveTestJSON-1483033820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:30.540062 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8bf15cb5-0cfb-417b-bbc4-12dec46006f8 tempest-AttachVolumeShelveTestJSON-1483033820 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:38:30.540694 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8bf15cb5-0cfb-417b-bbc4-12dec46006f8 tempest-AttachVolumeShelveTestJSON-1483033820 None] Volume volume-5b6ddcce-64a6-4813-bff3-73c4e4ef81d6 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:38:31.077847 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8bf15cb5-0cfb-417b-bbc4-12dec46006f8 tempest-AttachVolumeShelveTestJSON-1483033820 None] deleting rbd volume volume-5b6ddcce-64a6-4813-bff3-73c4e4ef81d6 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:38:32.304627 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-73e7d518-b055-4298-869d-742ba7bf85b9 tempest-SnapshotsActionsTest-1429847703 None] Created reservations ['a175c394-23a9-4ab4-b966-2dba54f7ff9f', '25d45ba2-a39b-4342-8053-8d85884dcad5', '5bdf2659-0a87-496d-bad6-edba9d6ea64c', 'db695511-c86a-4218-8cda-b6e3c10c56c5'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:38:32.500019 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-73e7d518-b055-4298-869d-742ba7bf85b9 tempest-SnapshotsActionsTest-1429847703 None] Delete snapshot completed successfully.
Apr 16 21:38:32.504494 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-73e7d518-b055-4298-869d-742ba7bf85b9 tempest-SnapshotsActionsTest-1429847703 None] Lock "b'cinder-6b4fcdfa-821e-4b9a-8e7f-e801ac58adee-delete_snapshot'" released by "delete_snapshot" :: held 10.851s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:38:32.730149 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:38:32.750494 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Flow 'volume_create_manager' (1e4e868f-0406-4eb9-8256-5ea80a2a7933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:38:32.757539 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c68f643-77f5-446c-b8fa-ea805f3d7368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:32.773680 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c68f643-77f5-446c-b8fa-ea805f3d7368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1015878848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=28750887-b609-470e-993c-c813005c694f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cd59bed2ee4321a269aa94736c23c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:38:33Z,use_quota=True,user_id='8c47684c2a894f6bb7c048bd2c40444a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:32.779210 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b378c1-92db-48fa-8f71-7e41fd979d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:32.783348 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b378c1-92db-48fa-8f71-7e41fd979d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:32.789190 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07675d48-e520-4e6b-a125-0889652a5534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:32.793442 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07675d48-e520-4e6b-a125-0889652a5534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28750887-b609-470e-993c-c813005c694f', 'volume_name': 'volume-28750887-b609-470e-993c-c813005c694f', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:32.798492 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a987fcf-a89f-4fd2-8bfe-e72783444d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:32.802674 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a987fcf-a89f-4fd2-8bfe-e72783444d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:32.807422 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb29e7ae-37da-48f1-a5fd-38df1c0d6ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:32.808546 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Volume 28750887-b609-470e-993c-c813005c694f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28750887-b609-470e-993c-c813005c694f', 'volume_size': 1}
Apr 16 21:38:32.808951 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] creating volume 'volume-28750887-b609-470e-993c-c813005c694f' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:38:32.809948 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:33.592035 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b079baf4-0fd8-4898-aa47-02ebfe9c3cdd tempest-SnapshotsActionsTest-888445623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:35.259161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:38:35.259875 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:38:35.263640 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb29e7ae-37da-48f1-a5fd-38df1c0d6ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28750887-b609-470e-993c-c813005c694f', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:35.268505 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b54e831-0089-4328-a528-060a75f7c23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:35.338225 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Volume volume-28750887-b609-470e-993c-c813005c694f (28750887-b609-470e-993c-c813005c694f): created successfully
Apr 16 21:38:35.342101 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b54e831-0089-4328-a528-060a75f7c23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:35.348414 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Flow 'volume_create_manager' (1e4e868f-0406-4eb9-8256-5ea80a2a7933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:38:35.425305 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-22358363-686d-4590-9853-7525fb02db8a tempest-VolumesListAdminTestJSON-732146326 None] Created volume successfully.
Apr 16 21:38:36.409988 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:38:36.430714 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Flow 'volume_create_manager' (af191ccb-5dbd-4968-aa1b-c8ff74ab1184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:38:36.437473 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306dde15-4ff3-410b-a7b6-6ed28a2bed37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:36.456346 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306dde15-4ff3-410b-a7b6-6ed28a2bed37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-553037212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=227e3738-d5c8-4093-8752-1895b752f0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cd59bed2ee4321a269aa94736c23c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:38:36Z,use_quota=True,user_id='8c47684c2a894f6bb7c048bd2c40444a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:36.462702 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ce2c71-e7ff-4906-aebd-3e3127d7cd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:36.467064 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ce2c71-e7ff-4906-aebd-3e3127d7cd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:36.472466 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2607eddf-ca62-4954-b183-ddc5e29cb19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:36.476671 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2607eddf-ca62-4954-b183-ddc5e29cb19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '227e3738-d5c8-4093-8752-1895b752f0a9', 'volume_name': 'volume-227e3738-d5c8-4093-8752-1895b752f0a9', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:36.481723 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4579f1-43cf-477c-93d3-e31a7231daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:36.485673 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4579f1-43cf-477c-93d3-e31a7231daf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:36.491063 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8f0e4d-fcd4-4935-a224-b314c11590cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:36.492143 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Volume 227e3738-d5c8-4093-8752-1895b752f0a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-227e3738-d5c8-4093-8752-1895b752f0a9', 'volume_size': 1}
Apr 16 21:38:36.492622 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] creating volume 'volume-227e3738-d5c8-4093-8752-1895b752f0a9' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:38:36.493289 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:38.770954 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:38:38.770954 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:38:38.770954 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8f0e4d-fcd4-4935-a224-b314c11590cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-227e3738-d5c8-4093-8752-1895b752f0a9', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:38.774802 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d49bea4-121c-4464-b498-f0829673c932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:38.888367 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Volume volume-227e3738-d5c8-4093-8752-1895b752f0a9 (227e3738-d5c8-4093-8752-1895b752f0a9): created successfully
Apr 16 21:38:38.892037 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d49bea4-121c-4464-b498-f0829673c932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:38.898076 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Flow 'volume_create_manager' (af191ccb-5dbd-4968-aa1b-c8ff74ab1184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:38:38.985261 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-228cdc3e-f577-4f5f-b7bc-bc8cf5c45601 tempest-VolumesListAdminTestJSON-732146326 None] Created volume successfully.
Apr 16 21:38:40.124133 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:38:40.143767 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Flow 'volume_create_manager' (1a92b3fe-ae3a-4ccc-a7d0-5e6ccea113b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:38:40.150550 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb55b20e-af06-47b1-b3f5-694889b5aeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:40.166584 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb55b20e-af06-47b1-b3f5-694889b5aeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-5333565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c4e93827-8d73-44a7-b0c0-eed9b18d692d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cd59bed2ee4321a269aa94736c23c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:38:40Z,use_quota=True,user_id='8c47684c2a894f6bb7c048bd2c40444a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:40.172001 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1dc0ea-956e-400e-8a3e-da3f5523ca20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:40.176422 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1dc0ea-956e-400e-8a3e-da3f5523ca20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:40.182198 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f72dfd-17f8-4443-bd11-5b3319d29aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:40.186278 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f72dfd-17f8-4443-bd11-5b3319d29aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4e93827-8d73-44a7-b0c0-eed9b18d692d', 'volume_name': 'volume-c4e93827-8d73-44a7-b0c0-eed9b18d692d', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:40.191327 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf6951f-e181-4028-9aa7-5aeae78b1d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:40.195361 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf6951f-e181-4028-9aa7-5aeae78b1d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:40.200097 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396d74b2-1779-4666-adbd-bade87010e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:40.201316 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Volume c4e93827-8d73-44a7-b0c0-eed9b18d692d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4e93827-8d73-44a7-b0c0-eed9b18d692d', 'volume_size': 1}
Apr 16 21:38:40.201706 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] creating volume 'volume-c4e93827-8d73-44a7-b0c0-eed9b18d692d' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:38:40.202355 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:41.854145 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b079baf4-0fd8-4898-aa47-02ebfe9c3cdd tempest-SnapshotsActionsTest-888445623 None] Create snapshot completed successfully
Apr 16 21:38:42.985311 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-aee22140-3417-4414-90ae-cfe958b36dee tempest-SnapshotsActionsTest-1429847703 None] Lock "b'cinder-0d282106-b56d-4f29-b25e-bd5eb6a2a734-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:38:42.987446 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aee22140-3417-4414-90ae-cfe958b36dee tempest-SnapshotsActionsTest-1429847703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:44.458728 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:38:44.459425 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:38:44.463012 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396d74b2-1779-4666-adbd-bade87010e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e93827-8d73-44a7-b0c0-eed9b18d692d', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:44.467707 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9c9118-922f-4c80-befb-8559382c0613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:44.527662 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Volume volume-c4e93827-8d73-44a7-b0c0-eed9b18d692d (c4e93827-8d73-44a7-b0c0-eed9b18d692d): created successfully
Apr 16 21:38:44.531301 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9c9118-922f-4c80-befb-8559382c0613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:44.536988 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Flow 'volume_create_manager' (1a92b3fe-ae3a-4ccc-a7d0-5e6ccea113b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:38:44.683976 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7615cf08-0506-4daa-8d86-6e5a01d920d6 tempest-VolumesListAdminTestJSON-732146326 None] Created volume successfully.
Apr 16 21:38:46.112540 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:38:46.132023 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Flow 'volume_create_manager' (19c2f432-266e-478c-9f49-84eb6e4c7d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:38:46.138844 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d88354-bca7-421a-86fc-3d4e2d2d26e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:46.155007 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d88354-bca7-421a-86fc-3d4e2d2d26e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f67d936-0867-4d04-acb7-e1cb88295600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc68bbec2104f1cbea817cf76223ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:38:46Z,use_quota=True,user_id='4abd7a6985b94db5bade4f0e36baa47c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:46.160650 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ae6367-021c-4e38-bb7c-7e97c1763df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:46.164930 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ae6367-021c-4e38-bb7c-7e97c1763df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:46.170092 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b80ee4-5f1f-44ce-b8ea-55ff36366d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:46.174147 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b80ee4-5f1f-44ce-b8ea-55ff36366d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f67d936-0867-4d04-acb7-e1cb88295600', 'volume_name': 'volume-2f67d936-0867-4d04-acb7-e1cb88295600', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:46.179674 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d015743-68ae-430b-b2c4-e643b4eafe48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:46.183561 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d015743-68ae-430b-b2c4-e643b4eafe48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:46.188320 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a799076-4299-4745-9276-5d3ce0eb316b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:46.189399 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Volume 2f67d936-0867-4d04-acb7-e1cb88295600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f67d936-0867-4d04-acb7-e1cb88295600', 'volume_size': 1}
Apr 16 21:38:46.189792 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] creating volume 'volume-2f67d936-0867-4d04-acb7-e1cb88295600' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:38:46.190455 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:49.528120 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:38:49.533742 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:38:49.533742 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a799076-4299-4745-9276-5d3ce0eb316b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f67d936-0867-4d04-acb7-e1cb88295600', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:49.536966 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae33526-305c-4a81-81ec-a69b6295a994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:38:49.664927 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Volume volume-2f67d936-0867-4d04-acb7-e1cb88295600 (2f67d936-0867-4d04-acb7-e1cb88295600): created successfully
Apr 16 21:38:49.669061 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae33526-305c-4a81-81ec-a69b6295a994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:38:49.674650 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Flow 'volume_create_manager' (19c2f432-266e-478c-9f49-84eb6e4c7d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:38:49.767247 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8e5dd23f-d22e-4f48-b70e-4bd92117ea9d tempest-VolumesListAdminTestJSON-2126301697 None] Created volume successfully.
Apr 16 21:38:50.293508 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8aa2aa5d-ef88-4591-8a5b-3e33550b8cbd tempest-VolumesListAdminTestJSON-2126301697 None] Lock "b'cinder-2f67d936-0867-4d04-acb7-e1cb88295600-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:38:50.400290 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8aa2aa5d-ef88-4591-8a5b-3e33550b8cbd tempest-VolumesListAdminTestJSON-2126301697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:51.003766 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8aa2aa5d-ef88-4591-8a5b-3e33550b8cbd tempest-VolumesListAdminTestJSON-2126301697 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:38:51.005238 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8aa2aa5d-ef88-4591-8a5b-3e33550b8cbd tempest-VolumesListAdminTestJSON-2126301697 None] Volume volume-2f67d936-0867-4d04-acb7-e1cb88295600 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:38:51.465699 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8aa2aa5d-ef88-4591-8a5b-3e33550b8cbd tempest-VolumesListAdminTestJSON-2126301697 None] deleting rbd volume volume-2f67d936-0867-4d04-acb7-e1cb88295600 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:38:51.485707 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-61a114f7-3375-4953-9493-d4981e24b368 tempest-VolumesListAdminTestJSON-732146326 None] Lock "b'cinder-c4e93827-8d73-44a7-b0c0-eed9b18d692d-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:38:51.632101 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-61a114f7-3375-4953-9493-d4981e24b368 tempest-VolumesListAdminTestJSON-732146326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:54.028604 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-61a114f7-3375-4953-9493-d4981e24b368 tempest-VolumesListAdminTestJSON-732146326 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:38:54.029886 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-61a114f7-3375-4953-9493-d4981e24b368 tempest-VolumesListAdminTestJSON-732146326 None] Volume volume-c4e93827-8d73-44a7-b0c0-eed9b18d692d is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:38:54.464872 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-61a114f7-3375-4953-9493-d4981e24b368 tempest-VolumesListAdminTestJSON-732146326 None] deleting rbd volume volume-c4e93827-8d73-44a7-b0c0-eed9b18d692d {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:38:54.582731 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-8bf15cb5-0cfb-417b-bbc4-12dec46006f8 tempest-AttachVolumeShelveTestJSON-1483033820 None] Created reservations ['3ef43dc1-83af-4d8e-9fdf-20fccfbeb3b7', 'eadda00f-c2b4-4f60-81ee-5459a2a6d317', 'c92f8484-2e86-4b4d-80a0-5543daf3b88c', 'b8f37b1e-5ed3-47a0-8dbe-48654727ffe2'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:38:54.790470 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8bf15cb5-0cfb-417b-bbc4-12dec46006f8 tempest-AttachVolumeShelveTestJSON-1483033820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:54.822274 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8bf15cb5-0cfb-417b-bbc4-12dec46006f8 tempest-AttachVolumeShelveTestJSON-1483033820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:54.847964 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8bf15cb5-0cfb-417b-bbc4-12dec46006f8 tempest-AttachVolumeShelveTestJSON-1483033820 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:38:54.852941 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8bf15cb5-0cfb-417b-bbc4-12dec46006f8 tempest-AttachVolumeShelveTestJSON-1483033820 None] Deleted volume successfully.
Apr 16 21:38:54.914792 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8bf15cb5-0cfb-417b-bbc4-12dec46006f8 tempest-AttachVolumeShelveTestJSON-1483033820 None] Lock "b'cinder-5b6ddcce-64a6-4813-bff3-73c4e4ef81d6-delete_volume'" released by "delete_volume" :: held 26.395s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:38:55.088767 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0fdae1e7-f62a-4476-a7af-d71c2a268d1b tempest-AttachVolumeShelveTestJSON-1483033820 None] Lock "b'cinder-53ad134b-66f9-4d7f-b696-56f6d63b72e9-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:38:55.225664 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0fdae1e7-f62a-4476-a7af-d71c2a268d1b tempest-AttachVolumeShelveTestJSON-1483033820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:38:56.070712 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0fdae1e7-f62a-4476-a7af-d71c2a268d1b tempest-AttachVolumeShelveTestJSON-1483033820 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:38:56.071532 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0fdae1e7-f62a-4476-a7af-d71c2a268d1b tempest-AttachVolumeShelveTestJSON-1483033820 None] Volume volume-53ad134b-66f9-4d7f-b696-56f6d63b72e9 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:38:56.513867 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0fdae1e7-f62a-4476-a7af-d71c2a268d1b tempest-AttachVolumeShelveTestJSON-1483033820 None] deleting rbd volume volume-53ad134b-66f9-4d7f-b696-56f6d63b72e9 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:38:56.658510 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-aee22140-3417-4414-90ae-cfe958b36dee tempest-SnapshotsActionsTest-1429847703 None] Created reservations ['534903dc-4c7b-4a8c-8557-291af22f9601', '76806a3f-132a-44d3-b002-70c21fd1aff0', 'dc5cfb6c-baf1-42e0-b9ac-eb5209b1d359', 'f31c9cab-5695-49e6-854e-8a7879b89103'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:38:56.836095 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-aee22140-3417-4414-90ae-cfe958b36dee tempest-SnapshotsActionsTest-1429847703 None] Delete snapshot completed successfully.
Apr 16 21:38:56.841195 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-aee22140-3417-4414-90ae-cfe958b36dee tempest-SnapshotsActionsTest-1429847703 None] Lock "b'cinder-0d282106-b56d-4f29-b25e-bd5eb6a2a734-delete_snapshot'" released by "delete_snapshot" :: held 13.856s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:38:58.168612 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8332bd99-7c6c-4b0d-8a5c-bccc54df3bbd tempest-SnapshotsActionsTest-888445623 None] Lock "b'cinder-a30c57f2-2e7f-40e8-bcdb-46b6ce72abde-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:38:58.171478 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8332bd99-7c6c-4b0d-8a5c-bccc54df3bbd tempest-SnapshotsActionsTest-888445623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:09.783633 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-8332bd99-7c6c-4b0d-8a5c-bccc54df3bbd tempest-SnapshotsActionsTest-888445623 None] Created reservations ['3c0ee3e9-1ebf-4e8d-8404-1075d919a547', 'bf9237ec-63a1-4ee6-9293-272d94554986', '2050d446-0caf-46eb-9c7f-eb88b3aaeece', '06c19e76-d6ad-4fd5-b6a8-d05d2e239948'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:39:09.930214 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8332bd99-7c6c-4b0d-8a5c-bccc54df3bbd tempest-SnapshotsActionsTest-888445623 None] Delete snapshot completed successfully.
Apr 16 21:39:09.938905 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8332bd99-7c6c-4b0d-8a5c-bccc54df3bbd tempest-SnapshotsActionsTest-888445623 None] Lock "b'cinder-a30c57f2-2e7f-40e8-bcdb-46b6ce72abde-delete_snapshot'" released by "delete_snapshot" :: held 11.767s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:39:10.786687 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a2f68ce4-5db2-4e09-a643-6739db9ed65e tempest-SnapshotsActionsTest-888445623 None] Lock "b'cinder-702b1d25-8267-4f44-8270-b34d39961e68-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:39:10.887214 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2f68ce4-5db2-4e09-a643-6739db9ed65e tempest-SnapshotsActionsTest-888445623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:12.040320 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2f68ce4-5db2-4e09-a643-6739db9ed65e tempest-SnapshotsActionsTest-888445623 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:39:12.040970 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2f68ce4-5db2-4e09-a643-6739db9ed65e tempest-SnapshotsActionsTest-888445623 None] Volume volume-702b1d25-8267-4f44-8270-b34d39961e68 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:39:12.663306 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2f68ce4-5db2-4e09-a643-6739db9ed65e tempest-SnapshotsActionsTest-888445623 None] deleting rbd volume volume-702b1d25-8267-4f44-8270-b34d39961e68 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:39:12.846521 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-61a114f7-3375-4953-9493-d4981e24b368 tempest-VolumesListAdminTestJSON-732146326 None] Created reservations ['7606f882-41d8-483e-b87c-fed416e486a3', 'af1cba01-a93c-42f3-8e0e-259d503ff3ea', 'cebb02bd-f626-4ae1-87a9-82757c7668e0', '1581b60d-d7fd-4e6f-a8b6-f35d56279167'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:39:13.064270 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-61a114f7-3375-4953-9493-d4981e24b368 tempest-VolumesListAdminTestJSON-732146326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:13.091399 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-61a114f7-3375-4953-9493-d4981e24b368 tempest-VolumesListAdminTestJSON-732146326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:13.117171 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-61a114f7-3375-4953-9493-d4981e24b368 tempest-VolumesListAdminTestJSON-732146326 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:39:13.124007 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-61a114f7-3375-4953-9493-d4981e24b368 tempest-VolumesListAdminTestJSON-732146326 None] Deleted volume successfully.
Apr 16 21:39:13.226969 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-61a114f7-3375-4953-9493-d4981e24b368 tempest-VolumesListAdminTestJSON-732146326 None] Lock "b'cinder-c4e93827-8d73-44a7-b0c0-eed9b18d692d-delete_volume'" released by "delete_volume" :: held 21.741s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:39:13.647796 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-0fdae1e7-f62a-4476-a7af-d71c2a268d1b tempest-AttachVolumeShelveTestJSON-1483033820 None] Created reservations ['c5bffc41-f86f-4daa-9827-66535be12e31', '8b658b59-4093-4128-bd3f-416aa4a0b079', '5a298f27-73c5-4d7d-acfe-e0e3d7f10414', 'b29898a1-6e3d-4a7e-8667-d5a743f4abf8'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:39:13.973963 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0fdae1e7-f62a-4476-a7af-d71c2a268d1b tempest-AttachVolumeShelveTestJSON-1483033820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:14.031781 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0fdae1e7-f62a-4476-a7af-d71c2a268d1b tempest-AttachVolumeShelveTestJSON-1483033820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:14.099444 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-0fdae1e7-f62a-4476-a7af-d71c2a268d1b tempest-AttachVolumeShelveTestJSON-1483033820 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:39:14.113120 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0fdae1e7-f62a-4476-a7af-d71c2a268d1b tempest-AttachVolumeShelveTestJSON-1483033820 None] Deleted volume successfully.
Apr 16 21:39:14.128504 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ef5da88c-9f9c-43c2-a0b5-80a8994f6067 tempest-VolumesListAdminTestJSON-732146326 None] Lock "b'cinder-227e3738-d5c8-4093-8752-1895b752f0a9-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:39:14.277931 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0fdae1e7-f62a-4476-a7af-d71c2a268d1b tempest-AttachVolumeShelveTestJSON-1483033820 None] Lock "b'cinder-53ad134b-66f9-4d7f-b696-56f6d63b72e9-delete_volume'" released by "delete_volume" :: held 19.189s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:39:14.333509 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ef5da88c-9f9c-43c2-a0b5-80a8994f6067 tempest-VolumesListAdminTestJSON-732146326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:14.793987 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ef5da88c-9f9c-43c2-a0b5-80a8994f6067 tempest-VolumesListAdminTestJSON-732146326 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:39:14.794575 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ef5da88c-9f9c-43c2-a0b5-80a8994f6067 tempest-VolumesListAdminTestJSON-732146326 None] Volume volume-227e3738-d5c8-4093-8752-1895b752f0a9 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:39:15.161402 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ef5da88c-9f9c-43c2-a0b5-80a8994f6067 tempest-VolumesListAdminTestJSON-732146326 None] deleting rbd volume volume-227e3738-d5c8-4093-8752-1895b752f0a9 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:39:15.286116 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-8aa2aa5d-ef88-4591-8a5b-3e33550b8cbd tempest-VolumesListAdminTestJSON-2126301697 None] Created reservations ['4cdd74b4-8401-4c89-95b9-3484224a53a2', 'f1daa9a2-ffea-4ba0-b665-b98facece508', '99621c88-e975-493f-bf9b-ceea14ce3a27', '7700394d-f293-452d-bb94-6b9566f5f61b'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:39:15.521327 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8aa2aa5d-ef88-4591-8a5b-3e33550b8cbd tempest-VolumesListAdminTestJSON-2126301697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:15.578435 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8aa2aa5d-ef88-4591-8a5b-3e33550b8cbd tempest-VolumesListAdminTestJSON-2126301697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:15.615822 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8aa2aa5d-ef88-4591-8a5b-3e33550b8cbd tempest-VolumesListAdminTestJSON-2126301697 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:39:15.629553 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8aa2aa5d-ef88-4591-8a5b-3e33550b8cbd tempest-VolumesListAdminTestJSON-2126301697 None] Deleted volume successfully.
Apr 16 21:39:15.729910 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8aa2aa5d-ef88-4591-8a5b-3e33550b8cbd tempest-VolumesListAdminTestJSON-2126301697 None] Lock "b'cinder-2f67d936-0867-4d04-acb7-e1cb88295600-delete_volume'" released by "delete_volume" :: held 25.436s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:39:19.958051 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c8b3e760-4eec-4d04-bf57-1b0b212994f0 tempest-TestVolumeBackupRestore-1675082881 None] Terminate volume connection completed successfully.
Apr 16 21:39:19.980402 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c8b3e760-4eec-4d04-bf57-1b0b212994f0 tempest-TestVolumeBackupRestore-1675082881 None] Remove volume export completed successfully.
Apr 16 21:39:21.569294 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cb2ef55b-4223-4da7-9fd0-1d3d20e5290b tempest-VolumesBackupsTest-493584864 None] Terminate volume connection completed successfully.
Apr 16 21:39:21.586890 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cb2ef55b-4223-4da7-9fd0-1d3d20e5290b tempest-VolumesBackupsTest-493584864 None] Remove volume export completed successfully.
Apr 16 21:39:22.452261 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:39:22.482920 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Flow 'volume_create_manager' (4de3c5b5-7d44-4b4c-b2e8-19d53c9dfe7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:39:22.491488 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02c3792-5d3f-4a36-90e0-356d09528bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:39:22.527465 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02c3792-5d3f-4a36-90e0-356d09528bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:39:22Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_ab06f9fe-c532-404f-b0e9-d1e0343b39c8',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9312ec94-740a-4dce-bd71-1c9d823af28d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80715ea8284b48959a67d33e8be6b560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:39:22Z,use_quota=True,user_id='52bbf82f2ac64a4c9e3b86975f8173b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:39:22.535010 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb929114-f942-45c4-a6d2-48dddb578028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:39:22.539665 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb929114-f942-45c4-a6d2-48dddb578028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:39:22.546312 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341d10c5-e295-438c-915c-20f27bc3a459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:39:22.550843 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341d10c5-e295-438c-915c-20f27bc3a459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9312ec94-740a-4dce-bd71-1c9d823af28d', 'volume_name': 'volume-9312ec94-740a-4dce-bd71-1c9d823af28d', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:39:22.556261 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f5e889-2a40-4c9f-96c9-69aadcb397b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:39:22.560794 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f5e889-2a40-4c9f-96c9-69aadcb397b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:39:22.565914 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc515f2-ae5d-47e6-9977-0bad1085eba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:39:22.567041 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Volume 9312ec94-740a-4dce-bd71-1c9d823af28d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9312ec94-740a-4dce-bd71-1c9d823af28d', 'volume_size': 1}
Apr 16 21:39:22.569620 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] creating volume 'volume-9312ec94-740a-4dce-bd71-1c9d823af28d' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:39:22.569620 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:22.743213 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-a2f68ce4-5db2-4e09-a643-6739db9ed65e tempest-SnapshotsActionsTest-888445623 None] Created reservations ['b862c3ea-4b69-4948-9008-60682530fe8d', '7d47b9e3-9f5c-4447-b3fb-bac0389a83c4', 'b9ba1735-59ae-4d49-a582-546b594891c8', '054ccd70-f5f2-41a4-b807-ad35a041b9ed'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:39:22.936088 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2f68ce4-5db2-4e09-a643-6739db9ed65e tempest-SnapshotsActionsTest-888445623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:22.962663 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2f68ce4-5db2-4e09-a643-6739db9ed65e tempest-SnapshotsActionsTest-888445623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:22.991508 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-a2f68ce4-5db2-4e09-a643-6739db9ed65e tempest-SnapshotsActionsTest-888445623 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:39:22.996278 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a2f68ce4-5db2-4e09-a643-6739db9ed65e tempest-SnapshotsActionsTest-888445623 None] Deleted volume successfully.
Apr 16 21:39:23.096143 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a2f68ce4-5db2-4e09-a643-6739db9ed65e tempest-SnapshotsActionsTest-888445623 None] Lock "b'cinder-702b1d25-8267-4f44-8270-b34d39961e68-delete_volume'" released by "delete_volume" :: held 12.309s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:39:23.234362 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-ef5da88c-9f9c-43c2-a0b5-80a8994f6067 tempest-VolumesListAdminTestJSON-732146326 None] Created reservations ['7ae369ac-f4b7-450b-955f-b17458629cb2', '5f8d07ed-60ab-404d-a92e-b72ba27c39ac', '6eeb6110-405b-42ba-8223-25afdcacb09d', '87e73837-6d63-4e3b-b405-4c5d7e9a8247'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:39:23.335313 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:39:23.335760 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:39:23.347358 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc515f2-ae5d-47e6-9977-0bad1085eba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9312ec94-740a-4dce-bd71-1c9d823af28d', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:39:23.347358 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246cff06-6650-43c9-b4e5-d4b4f2c61f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:39:23.432314 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Volume volume-9312ec94-740a-4dce-bd71-1c9d823af28d (9312ec94-740a-4dce-bd71-1c9d823af28d): created successfully
Apr 16 21:39:23.438328 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246cff06-6650-43c9-b4e5-d4b4f2c61f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:39:23.445128 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Flow 'volume_create_manager' (4de3c5b5-7d44-4b4c-b2e8-19d53c9dfe7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:39:23.462121 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ef5da88c-9f9c-43c2-a0b5-80a8994f6067 tempest-VolumesListAdminTestJSON-732146326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:23.513901 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ef5da88c-9f9c-43c2-a0b5-80a8994f6067 tempest-VolumesListAdminTestJSON-732146326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:23.617558 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-ef5da88c-9f9c-43c2-a0b5-80a8994f6067 tempest-VolumesListAdminTestJSON-732146326 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:39:23.624428 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Created volume successfully.
Apr 16 21:39:23.630753 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ef5da88c-9f9c-43c2-a0b5-80a8994f6067 tempest-VolumesListAdminTestJSON-732146326 None] Deleted volume successfully.
Apr 16 21:39:23.771071 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ef5da88c-9f9c-43c2-a0b5-80a8994f6067 tempest-VolumesListAdminTestJSON-732146326 None] Lock "b'cinder-227e3738-d5c8-4093-8752-1895b752f0a9-delete_volume'" released by "delete_volume" :: held 9.644s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:39:23.881802 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:39:23.902554 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Flow 'volume_create_manager' (1747d38f-ea90-4aff-a1f6-3349ba2ab99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:39:23.909427 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0779ba80-e995-4f4e-981f-3a3d6857dd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:39:23.925541 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0779ba80-e995-4f4e-981f-3a3d6857dd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:39:23Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_9c0f0465-f3dc-45d2-801b-939c0d169abe',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e84da828-0f94-4f59-8e11-fac1f7cb4977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51b576f9c0241c1a254f15308a455ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:39:24Z,use_quota=True,user_id='77f61ccbf5114e6080e33f0c5f500468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:39:23.931314 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa356592-0289-47db-a7a3-96053cf0d317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:39:23.935633 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa356592-0289-47db-a7a3-96053cf0d317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:39:23.940926 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8671bc13-a1c6-4674-9efd-f1f6c6d177b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:39:23.945234 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8671bc13-a1c6-4674-9efd-f1f6c6d177b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e84da828-0f94-4f59-8e11-fac1f7cb4977', 'volume_name': 'volume-e84da828-0f94-4f59-8e11-fac1f7cb4977', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:39:23.950470 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dfb3e96-4518-425d-ac08-bd7b8ffc6893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:39:23.954580 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dfb3e96-4518-425d-ac08-bd7b8ffc6893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:39:23.959990 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ac62f5-94ec-4854-a387-ecbdd2733b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:39:23.961164 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Volume e84da828-0f94-4f59-8e11-fac1f7cb4977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e84da828-0f94-4f59-8e11-fac1f7cb4977', 'volume_size': 1}
Apr 16 21:39:23.961742 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] creating volume 'volume-e84da828-0f94-4f59-8e11-fac1f7cb4977' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:39:23.962547 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:24.567902 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:39:24.728158 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:39:24.729190 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:39:24.736553 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ac62f5-94ec-4854-a387-ecbdd2733b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e84da828-0f94-4f59-8e11-fac1f7cb4977', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:39:24.773993 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79c758c-d4bc-400a-8b31-4a50d6cc681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:39:24.852367 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-99498dbc-33d3-4377-82e5-d2177cb4613e tempest-VolumesListAdminTestJSON-732146326 None] Lock "b'cinder-28750887-b609-470e-993c-c813005c694f-delete_volume'" acquired by "delete_volume" :: waited 0.044s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:39:24.903446 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Volume volume-e84da828-0f94-4f59-8e11-fac1f7cb4977 (e84da828-0f94-4f59-8e11-fac1f7cb4977): created successfully
Apr 16 21:39:24.909266 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79c758c-d4bc-400a-8b31-4a50d6cc681b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:39:24.918745 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Flow 'volume_create_manager' (1747d38f-ea90-4aff-a1f6-3349ba2ab99b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:39:24.986998 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Created volume successfully.
Apr 16 21:39:25.031238 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99498dbc-33d3-4377-82e5-d2177cb4613e tempest-VolumesListAdminTestJSON-732146326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:25.203813 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99498dbc-33d3-4377-82e5-d2177cb4613e tempest-VolumesListAdminTestJSON-732146326 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:39:25.208524 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99498dbc-33d3-4377-82e5-d2177cb4613e tempest-VolumesListAdminTestJSON-732146326 None] Volume volume-28750887-b609-470e-993c-c813005c694f is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:39:25.377504 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99498dbc-33d3-4377-82e5-d2177cb4613e tempest-VolumesListAdminTestJSON-732146326 None] deleting rbd volume volume-28750887-b609-470e-993c-c813005c694f {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:39:25.453141 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.886s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:39:25.453934 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9312ec94-740a-4dce-bd71-1c9d823af28d', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '9312ec94-740a-4dce-bd71-1c9d823af28d', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:39:25.470087 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Initialize volume connection completed successfully.
Apr 16 21:39:26.141825 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:39:27.154510 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.011s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:39:27.161642 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e84da828-0f94-4f59-8e11-fac1f7cb4977', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'e84da828-0f94-4f59-8e11-fac1f7cb4977', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:39:27.201509 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Initialize volume connection completed successfully.
Apr 16 21:39:28.621827 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:39:28.627706 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:28.722340 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:28.775599 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:39:34.296918 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-99498dbc-33d3-4377-82e5-d2177cb4613e tempest-VolumesListAdminTestJSON-732146326 None] Created reservations ['a1fdeb28-fa97-42b2-84fe-4a38970e5c78', '1d93ef5d-d084-4420-8c8a-e16fe61cd332', 'e69abdd9-dbad-4d0a-8654-05ff8ebc835d', '6ae02e1e-d884-470a-a08f-08e54e969d02'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:39:34.505163 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99498dbc-33d3-4377-82e5-d2177cb4613e tempest-VolumesListAdminTestJSON-732146326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:34.635862 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99498dbc-33d3-4377-82e5-d2177cb4613e tempest-VolumesListAdminTestJSON-732146326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:39:34.890470 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-99498dbc-33d3-4377-82e5-d2177cb4613e tempest-VolumesListAdminTestJSON-732146326 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:39:34.896045 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-99498dbc-33d3-4377-82e5-d2177cb4613e tempest-VolumesListAdminTestJSON-732146326 None] Deleted volume successfully.
Apr 16 21:39:34.986695 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-99498dbc-33d3-4377-82e5-d2177cb4613e tempest-VolumesListAdminTestJSON-732146326 None] Lock "b'cinder-28750887-b609-470e-993c-c813005c694f-delete_volume'" released by "delete_volume" :: held 10.136s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:40:04.944474 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:40:04.996617 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Flow 'volume_create_manager' (858ead14-fcb2-477f-ac4c-d72537804be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:40:05.008863 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95bace86-5dfb-4346-ab49-8e8184786f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:05.026879 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95bace86-5dfb-4346-ab49-8e8184786f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-855235578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ff57fde7-6edb-43ee-b977-bdc95436dafa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96a293eac61499182c2a30c324d461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:40:05Z,use_quota=True,user_id='f6e4f0060ec44989882b3b21624cb87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:05.032802 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6378c3a-5df7-4fdc-b804-401a38a8b751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:05.037205 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6378c3a-5df7-4fdc-b804-401a38a8b751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:05.042612 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed701e6-5d78-421c-a957-d8638d37b2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:05.049229 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed701e6-5d78-421c-a957-d8638d37b2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff57fde7-6edb-43ee-b977-bdc95436dafa', 'volume_name': 'volume-ff57fde7-6edb-43ee-b977-bdc95436dafa', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:05.055484 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbeb7171-5dc4-48cb-b421-b2c6c970584c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:05.059713 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbeb7171-5dc4-48cb-b421-b2c6c970584c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:05.065476 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3d0b31-f449-4918-8e2e-52942fe7df8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:05.066769 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Volume ff57fde7-6edb-43ee-b977-bdc95436dafa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff57fde7-6edb-43ee-b977-bdc95436dafa', 'volume_size': 1}
Apr 16 21:40:05.067325 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] creating volume 'volume-ff57fde7-6edb-43ee-b977-bdc95436dafa' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:40:05.068312 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:40:10.140778 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:40:10.141452 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:40:10.145938 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3d0b31-f449-4918-8e2e-52942fe7df8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff57fde7-6edb-43ee-b977-bdc95436dafa', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:10.151039 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44eae94a-bbfc-47d8-96aa-affec14332ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:10.237627 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Volume volume-ff57fde7-6edb-43ee-b977-bdc95436dafa (ff57fde7-6edb-43ee-b977-bdc95436dafa): created successfully
Apr 16 21:40:10.241400 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44eae94a-bbfc-47d8-96aa-affec14332ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:10.247559 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Flow 'volume_create_manager' (858ead14-fcb2-477f-ac4c-d72537804be0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:40:10.331025 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-dada2f7e-e135-4251-83c3-fd76d35e70d7 tempest-VolumesActionsTest-1967188215 None] Created volume successfully.
Apr 16 21:40:11.047267 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-cb65f53e-87e9-478f-ad29-0f5ee160ae05 tempest-VolumesActionsTest-1967188215 None] Lock "b'cinder-ff57fde7-6edb-43ee-b977-bdc95436dafa'" acquired by "attach_volume" :: waited 0.008s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:40:11.279486 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cb65f53e-87e9-478f-ad29-0f5ee160ae05 tempest-VolumesActionsTest-1967188215 None] Attaching volume ff57fde7-6edb-43ee-b977-bdc95436dafa to instance 9e6e9f1d-bd16-433f-b71c-28676755ada1 at mountpoint /dev/sdb on host None.
Apr 16 21:40:11.346622 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cb65f53e-87e9-478f-ad29-0f5ee160ae05 tempest-VolumesActionsTest-1967188215 None] Attach volume completed successfully.
Apr 16 21:40:11.357237 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-cb65f53e-87e9-478f-ad29-0f5ee160ae05 tempest-VolumesActionsTest-1967188215 None] Lock "b'cinder-ff57fde7-6edb-43ee-b977-bdc95436dafa'" released by "attach_volume" :: held 0.304s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:40:11.946569 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-62d2d151-6cac-4ff0-a500-9ac1ea43a4d1 tempest-VolumesActionsTest-676127324 None] Terminate volume connection completed successfully.
Apr 16 21:40:11.978836 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-62d2d151-6cac-4ff0-a500-9ac1ea43a4d1 tempest-VolumesActionsTest-676127324 None] Lock "b'cinder-ff57fde7-6edb-43ee-b977-bdc95436dafa-detach_volume'" acquired by "detach_volume" :: waited 0.008s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:40:11.990218 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-62d2d151-6cac-4ff0-a500-9ac1ea43a4d1 tempest-VolumesActionsTest-676127324 None] Detaching volume ff57fde7-6edb-43ee-b977-bdc95436dafa from instance 9e6e9f1d-bd16-433f-b71c-28676755ada1.
Apr 16 21:40:12.237414 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-62d2d151-6cac-4ff0-a500-9ac1ea43a4d1 tempest-VolumesActionsTest-676127324 None] Detach volume completed successfully.
Apr 16 21:40:12.241809 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-62d2d151-6cac-4ff0-a500-9ac1ea43a4d1 tempest-VolumesActionsTest-676127324 None] Lock "b'cinder-ff57fde7-6edb-43ee-b977-bdc95436dafa-detach_volume'" released by "detach_volume" :: held 0.263s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:40:12.387684 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f5db6629-d9ca-4327-a6a9-ccb50da505ed tempest-VolumesActionsTest-1967188215 None] Lock "b'cinder-ff57fde7-6edb-43ee-b977-bdc95436dafa-detach_volume'" acquired by "detach_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:40:12.388302 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f5db6629-d9ca-4327-a6a9-ccb50da505ed tempest-VolumesActionsTest-1967188215 None] Volume detach called, but volume not attached.
Apr 16 21:40:12.399024 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f5db6629-d9ca-4327-a6a9-ccb50da505ed tempest-VolumesActionsTest-1967188215 None] Lock "b'cinder-ff57fde7-6edb-43ee-b977-bdc95436dafa-detach_volume'" released by "detach_volume" :: held 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:40:17.175786 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:40:17.196249 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Flow 'volume_create_manager' (83f58763-63b3-47ae-b315-c9ba3f69b569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:40:17.202628 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a069e82-2b03-4b28-8f24-f9657eadac4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:17.218239 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a069e82-2b03-4b28-8f24-f9657eadac4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-513230744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a01d98a4-d278-436d-a980-8ec8f9c8f8a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96a293eac61499182c2a30c324d461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:40:17Z,use_quota=True,user_id='f6e4f0060ec44989882b3b21624cb87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:17.224712 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ab1dac-4391-443b-879d-ff9f15ddb5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:17.229058 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ab1dac-4391-443b-879d-ff9f15ddb5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:17.234395 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3c729b-1c7b-438d-b425-4f5b3517e0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:17.238816 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3c729b-1c7b-438d-b425-4f5b3517e0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01d98a4-d278-436d-a980-8ec8f9c8f8a0', 'volume_name': 'volume-a01d98a4-d278-436d-a980-8ec8f9c8f8a0', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:17.244054 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131fb230-d39b-4e87-8cf1-61208b7816a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:17.248128 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131fb230-d39b-4e87-8cf1-61208b7816a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:17.253482 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a7a2d0-143f-402d-a03c-926665d1f776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:17.254559 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Volume a01d98a4-d278-436d-a980-8ec8f9c8f8a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01d98a4-d278-436d-a980-8ec8f9c8f8a0', 'volume_size': 1}
Apr 16 21:40:17.254947 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] creating volume 'volume-a01d98a4-d278-436d-a980-8ec8f9c8f8a0' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:40:17.255609 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:40:19.629434 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:40:19.630313 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:40:19.633814 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a7a2d0-143f-402d-a03c-926665d1f776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01d98a4-d278-436d-a980-8ec8f9c8f8a0', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:19.638507 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3bb991-4ff4-49e4-94a8-233d8ded5bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:19.745851 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Volume volume-a01d98a4-d278-436d-a980-8ec8f9c8f8a0 (a01d98a4-d278-436d-a980-8ec8f9c8f8a0): created successfully
Apr 16 21:40:19.749847 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3bb991-4ff4-49e4-94a8-233d8ded5bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:19.755598 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Flow 'volume_create_manager' (83f58763-63b3-47ae-b315-c9ba3f69b569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:40:19.886454 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-31d67c73-c3ab-4875-a2a9-1b571afb95b5 tempest-VolumesActionsTest-1967188215 None] Created volume successfully.
Apr 16 21:40:20.458677 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-02d88bb1-46f2-4edf-b10a-29fe13af566a tempest-VolumesActionsTest-676127324 None] Lock "b'cinder-a01d98a4-d278-436d-a980-8ec8f9c8f8a0-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:40:20.554503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-02d88bb1-46f2-4edf-b10a-29fe13af566a tempest-VolumesActionsTest-676127324 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:40:21.831455 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-02d88bb1-46f2-4edf-b10a-29fe13af566a tempest-VolumesActionsTest-676127324 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:40:21.832875 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-02d88bb1-46f2-4edf-b10a-29fe13af566a tempest-VolumesActionsTest-676127324 None] Volume volume-a01d98a4-d278-436d-a980-8ec8f9c8f8a0 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:40:22.483280 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-02d88bb1-46f2-4edf-b10a-29fe13af566a tempest-VolumesActionsTest-676127324 None] deleting rbd volume volume-a01d98a4-d278-436d-a980-8ec8f9c8f8a0 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:40:26.487649 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:40:26.506764 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Flow 'volume_create_manager' (6af87f62-e05a-419b-9f42-99fffb904574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:40:26.513347 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4dfde8e-226e-4284-b8c3-8a053a4a941c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:26.529098 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4dfde8e-226e-4284-b8c3-8a053a4a941c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1778529679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c83e6b4d-92b1-4775-8ed2-19365c945f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fc33178ac5b4d4f9c1f346e3b4371b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:40:26Z,use_quota=True,user_id='8b67f0226ea247ae857b18891e0834f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:26.535122 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a514c6-cf2a-4753-b315-911f2e1a74d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:26.539361 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a514c6-cf2a-4753-b315-911f2e1a74d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:26.544860 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b5b1c70-dad8-4772-9e99-da03a8dcae4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:26.549106 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b5b1c70-dad8-4772-9e99-da03a8dcae4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c83e6b4d-92b1-4775-8ed2-19365c945f19', 'volume_name': 'volume-c83e6b4d-92b1-4775-8ed2-19365c945f19', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:26.554677 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d80121-966c-4b02-9261-d96279c74b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:26.558649 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d80121-966c-4b02-9261-d96279c74b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:26.563442 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba91d0d-1c57-4000-843e-309a7fb70271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:26.564560 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Volume c83e6b4d-92b1-4775-8ed2-19365c945f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c83e6b4d-92b1-4775-8ed2-19365c945f19', 'volume_size': 1}
Apr 16 21:40:26.564974 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] creating volume 'volume-c83e6b4d-92b1-4775-8ed2-19365c945f19' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:40:26.565642 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:40:28.619158 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:40:28.619814 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:40:28.640967 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:40:28.662074 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:40:28.728379 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:40:28.728762 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:40:28.732597 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba91d0d-1c57-4000-843e-309a7fb70271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c83e6b4d-92b1-4775-8ed2-19365c945f19', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:28.737289 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53e3f98-6be3-4878-a12f-9ad76c5222f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:28.822561 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Volume volume-c83e6b4d-92b1-4775-8ed2-19365c945f19 (c83e6b4d-92b1-4775-8ed2-19365c945f19): created successfully
Apr 16 21:40:28.826270 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53e3f98-6be3-4878-a12f-9ad76c5222f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:28.832071 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Flow 'volume_create_manager' (6af87f62-e05a-419b-9f42-99fffb904574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:40:28.960638 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7526ec62-9ab0-45bb-b014-da547e046a63 tempest-AttachVolumeTestJSON-1623236864 None] Created volume successfully.
Apr 16 21:40:30.464973 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-fd1bfd7b-f0f0-47a5-9ac5-c5063cc1d861 req-99383852-3352-4ccd-b0ac-fbba1973640a tempest-AttachVolumeTestJSON-1623236864 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:40:31.171729 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-fd1bfd7b-f0f0-47a5-9ac5-c5063cc1d861 req-99383852-3352-4ccd-b0ac-fbba1973640a tempest-AttachVolumeTestJSON-1623236864 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.706s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:40:31.172618 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-fd1bfd7b-f0f0-47a5-9ac5-c5063cc1d861 req-99383852-3352-4ccd-b0ac-fbba1973640a tempest-AttachVolumeTestJSON-1623236864 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c83e6b4d-92b1-4775-8ed2-19365c945f19', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'c83e6b4d-92b1-4775-8ed2-19365c945f19', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:40:31.257538 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-fd1bfd7b-f0f0-47a5-9ac5-c5063cc1d861 req-99383852-3352-4ccd-b0ac-fbba1973640a tempest-AttachVolumeTestJSON-1623236864 None] Connection info returned from driver {'name': 'volumes/volume-c83e6b4d-92b1-4775-8ed2-19365c945f19', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c83e6b4d-92b1-4775-8ed2-19365c945f19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '91f591e4-f556-432f-83fb-91d24f8976da'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:40:31.381893 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-fd1bfd7b-f0f0-47a5-9ac5-c5063cc1d861 req-99383852-3352-4ccd-b0ac-fbba1973640a tempest-AttachVolumeTestJSON-1623236864 None] attachment_update completed successfully.
Apr 16 21:40:40.384188 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-02d88bb1-46f2-4edf-b10a-29fe13af566a tempest-VolumesActionsTest-676127324 None] Created reservations ['92dbd721-dfb6-4ca1-80d6-ff88a8c956c4', '4b02d241-a158-4f32-b415-d152a86ba1aa', 'c601fd12-2aea-4204-873b-8bf4d6cc32bf', '7433e385-38c9-4eb0-a13f-86a248db3b15'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:40:40.560224 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-02d88bb1-46f2-4edf-b10a-29fe13af566a tempest-VolumesActionsTest-676127324 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:40:40.646619 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-02d88bb1-46f2-4edf-b10a-29fe13af566a tempest-VolumesActionsTest-676127324 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:40:40.670771 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-02d88bb1-46f2-4edf-b10a-29fe13af566a tempest-VolumesActionsTest-676127324 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:40:40.676709 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-02d88bb1-46f2-4edf-b10a-29fe13af566a tempest-VolumesActionsTest-676127324 None] Deleted volume successfully.
Apr 16 21:40:40.775022 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-02d88bb1-46f2-4edf-b10a-29fe13af566a tempest-VolumesActionsTest-676127324 None] Lock "b'cinder-a01d98a4-d278-436d-a980-8ec8f9c8f8a0-delete_volume'" released by "delete_volume" :: held 20.316s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:40:42.323196 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:40:42.344349 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Flow 'volume_create_manager' (83acd945-820e-43c1-9736-82c222f3bb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:40:42.351760 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6fbcedd-4f5f-4cdd-b297-b95559d1d8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:42.369780 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6fbcedd-4f5f-4cdd-b297-b95559d1d8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-213897565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0633812a-6a57-4503-a547-0cbcb06ef278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96a293eac61499182c2a30c324d461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:40:42Z,use_quota=True,user_id='f6e4f0060ec44989882b3b21624cb87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:42.374817 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c642175-99c6-4de2-b71b-cdcfdc573b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:42.378972 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c642175-99c6-4de2-b71b-cdcfdc573b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:42.384426 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a07f1cc-882f-4a35-8284-32de3cb32ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:42.388529 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a07f1cc-882f-4a35-8284-32de3cb32ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0633812a-6a57-4503-a547-0cbcb06ef278', 'volume_name': 'volume-0633812a-6a57-4503-a547-0cbcb06ef278', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:42.393502 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8f6766-fc9f-46dc-9e70-357513c8513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:42.397939 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8f6766-fc9f-46dc-9e70-357513c8513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:42.402701 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d571cd-356c-4666-ae67-0c4d1ab340d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:42.403785 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Volume 0633812a-6a57-4503-a547-0cbcb06ef278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0633812a-6a57-4503-a547-0cbcb06ef278', 'volume_size': 1}
Apr 16 21:40:42.404201 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] creating volume 'volume-0633812a-6a57-4503-a547-0cbcb06ef278' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:40:42.404990 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:40:44.553009 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:40:44.553546 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:40:44.557182 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d571cd-356c-4666-ae67-0c4d1ab340d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0633812a-6a57-4503-a547-0cbcb06ef278', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:44.561806 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c42cb80-5171-49a7-9973-7e7150b9726b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:44.635408 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Volume volume-0633812a-6a57-4503-a547-0cbcb06ef278 (0633812a-6a57-4503-a547-0cbcb06ef278): created successfully
Apr 16 21:40:44.639044 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c42cb80-5171-49a7-9973-7e7150b9726b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:44.644790 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Flow 'volume_create_manager' (83acd945-820e-43c1-9736-82c222f3bb7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:40:44.715283 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a8026eb3-3d76-4dc4-92f3-5b20d504cb15 tempest-VolumesActionsTest-1967188215 None] Created volume successfully.
Apr 16 21:40:45.639698 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3b7b62ce-cb29-4c1d-8d63-825d46a8dbac tempest-VolumesActionsTest-676127324 None] Lock "b'cinder-0633812a-6a57-4503-a547-0cbcb06ef278-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:40:45.752823 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3b7b62ce-cb29-4c1d-8d63-825d46a8dbac tempest-VolumesActionsTest-676127324 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:40:45.995049 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3b7b62ce-cb29-4c1d-8d63-825d46a8dbac tempest-VolumesActionsTest-676127324 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:40:45.995433 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3b7b62ce-cb29-4c1d-8d63-825d46a8dbac tempest-VolumesActionsTest-676127324 None] Volume volume-0633812a-6a57-4503-a547-0cbcb06ef278 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:40:46.199975 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3b7b62ce-cb29-4c1d-8d63-825d46a8dbac tempest-VolumesActionsTest-676127324 None] deleting rbd volume volume-0633812a-6a57-4503-a547-0cbcb06ef278 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:40:46.403515 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Terminate volume connection completed successfully.
Apr 16 21:40:46.421347 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-076de2d0-d325-4c1d-8cdd-b04ea03a1420 tempest-TestVolumeBackupRestore-1675082881 None] Remove volume export completed successfully.
Apr 16 21:40:47.956851 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Terminate volume connection completed successfully.
Apr 16 21:40:47.987799 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-698107ed-98a0-4ce4-add6-08003883f586 tempest-VolumesBackupsTest-493584864 None] Remove volume export completed successfully.
Apr 16 21:40:48.763614 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-145f77ad-ce91-4fb1-97ce-4dc14ab3ee03 tempest-VolumesBackupsTest-493584864 None] Lock "b'cinder-e84da828-0f94-4f59-8e11-fac1f7cb4977-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:40:48.887404 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-145f77ad-ce91-4fb1-97ce-4dc14ab3ee03 tempest-VolumesBackupsTest-493584864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:40:50.767452 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-145f77ad-ce91-4fb1-97ce-4dc14ab3ee03 tempest-VolumesBackupsTest-493584864 None] Volume volume-e84da828-0f94-4f59-8e11-fac1f7cb4977 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:40:51.136619 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-145f77ad-ce91-4fb1-97ce-4dc14ab3ee03 tempest-VolumesBackupsTest-493584864 None] deleting rbd volume volume-e84da828-0f94-4f59-8e11-fac1f7cb4977 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:40:51.290139 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-3b7b62ce-cb29-4c1d-8d63-825d46a8dbac tempest-VolumesActionsTest-676127324 None] Created reservations ['0969fa9f-f474-44e3-bae2-ef449011496c', '9d91c5a1-3e37-4cae-9439-6edc4fe2665b', 'd084d38a-6bd3-4504-973a-b97c8a5f72ee', '5ea273db-dcd9-4d6b-a68b-6b295dc8c102'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:40:51.662010 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3b7b62ce-cb29-4c1d-8d63-825d46a8dbac tempest-VolumesActionsTest-676127324 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:40:51.794586 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3b7b62ce-cb29-4c1d-8d63-825d46a8dbac tempest-VolumesActionsTest-676127324 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:40:51.817339 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-3b7b62ce-cb29-4c1d-8d63-825d46a8dbac tempest-VolumesActionsTest-676127324 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:40:51.821477 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3b7b62ce-cb29-4c1d-8d63-825d46a8dbac tempest-VolumesActionsTest-676127324 None] Deleted volume successfully.
Apr 16 21:40:51.917282 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3b7b62ce-cb29-4c1d-8d63-825d46a8dbac tempest-VolumesActionsTest-676127324 None] Lock "b'cinder-0633812a-6a57-4503-a547-0cbcb06ef278-delete_volume'" released by "delete_volume" :: held 6.278s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:40:52.836704 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:40:52.857337 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Flow 'volume_create_manager' (32d79a65-cf1f-4a12-9138-2e581df384ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:40:52.864779 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69dcb1c7-d430-443e-9d3d-ceb0f99db90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:52.880805 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69dcb1c7-d430-443e-9d3d-ceb0f99db90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1036970921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2809aff5-2a43-49ab-8f25-c26d21f0ef41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96a293eac61499182c2a30c324d461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:40:53Z,use_quota=True,user_id='f6e4f0060ec44989882b3b21624cb87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:52.886273 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef9d39d-41ef-47b7-ae11-fd5e22f8426a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:52.890463 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef9d39d-41ef-47b7-ae11-fd5e22f8426a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:52.895691 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96726d9c-004d-4d9a-b741-787fa6a7b4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:52.899810 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96726d9c-004d-4d9a-b741-787fa6a7b4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2809aff5-2a43-49ab-8f25-c26d21f0ef41', 'volume_name': 'volume-2809aff5-2a43-49ab-8f25-c26d21f0ef41', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:52.904896 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b6a95b-bec2-4b28-a099-257d19b66da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:52.908838 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b6a95b-bec2-4b28-a099-257d19b66da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:52.913650 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a71f86-b626-415d-8be9-4c587bfa4fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:52.914741 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Volume 2809aff5-2a43-49ab-8f25-c26d21f0ef41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2809aff5-2a43-49ab-8f25-c26d21f0ef41', 'volume_size': 1}
Apr 16 21:40:52.915134 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] creating volume 'volume-2809aff5-2a43-49ab-8f25-c26d21f0ef41' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:40:52.915917 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:40:53.934127 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 req-a9ad34f4-5be9-4e63-b3bf-d31482c11d3e tempest-TestVolumeBackupRestore-1675082881 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:40:54.064972 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:40:54.065498 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:40:54.073959 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a71f86-b626-415d-8be9-4c587bfa4fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2809aff5-2a43-49ab-8f25-c26d21f0ef41', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:54.080252 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c107529-312d-4a0f-84ec-cf975cf46a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:40:54.172783 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Volume volume-2809aff5-2a43-49ab-8f25-c26d21f0ef41 (2809aff5-2a43-49ab-8f25-c26d21f0ef41): created successfully
Apr 16 21:40:54.176822 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c107529-312d-4a0f-84ec-cf975cf46a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:40:54.182859 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Flow 'volume_create_manager' (32d79a65-cf1f-4a12-9138-2e581df384ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:40:54.263436 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e41ce1b6-53e6-4357-9eb2-b61d2a740ea6 tempest-VolumesActionsTest-1967188215 None] Created volume successfully.
Apr 16 21:40:54.597451 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 req-a9ad34f4-5be9-4e63-b3bf-d31482c11d3e tempest-TestVolumeBackupRestore-1675082881 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.663s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:40:54.598659 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 req-a9ad34f4-5be9-4e63-b3bf-d31482c11d3e tempest-TestVolumeBackupRestore-1675082881 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9312ec94-740a-4dce-bd71-1c9d823af28d', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '9312ec94-740a-4dce-bd71-1c9d823af28d', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:40:54.673405 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 req-a9ad34f4-5be9-4e63-b3bf-d31482c11d3e tempest-TestVolumeBackupRestore-1675082881 None] Connection info returned from driver {'name': 'volumes/volume-9312ec94-740a-4dce-bd71-1c9d823af28d', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9312ec94-740a-4dce-bd71-1c9d823af28d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4cf305a4-12bc-4b4e-8c11-2846e4aa00d7'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:40:54.795673 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 req-a9ad34f4-5be9-4e63-b3bf-d31482c11d3e tempest-TestVolumeBackupRestore-1675082881 None] attachment_update completed successfully.
Apr 16 21:40:55.157453 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-cdd64cf8-7a6b-4f3d-80b9-bbdc893046d5 tempest-VolumesActionsTest-676127324 None] Lock "b'cinder-2809aff5-2a43-49ab-8f25-c26d21f0ef41-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:40:55.248323 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cdd64cf8-7a6b-4f3d-80b9-bbdc893046d5 tempest-VolumesActionsTest-676127324 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:40:55.464576 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cdd64cf8-7a6b-4f3d-80b9-bbdc893046d5 tempest-VolumesActionsTest-676127324 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:40:55.466111 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cdd64cf8-7a6b-4f3d-80b9-bbdc893046d5 tempest-VolumesActionsTest-676127324 None] Volume volume-2809aff5-2a43-49ab-8f25-c26d21f0ef41 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:40:55.793751 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cdd64cf8-7a6b-4f3d-80b9-bbdc893046d5 tempest-VolumesActionsTest-676127324 None] deleting rbd volume volume-2809aff5-2a43-49ab-8f25-c26d21f0ef41 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:41:00.234657 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-145f77ad-ce91-4fb1-97ce-4dc14ab3ee03 tempest-VolumesBackupsTest-493584864 None] Created reservations ['97f2eb26-3bb7-45af-b84d-90ddf7960d53', '6aaf1d7c-3311-40e0-8f80-144ab8d9f4f9', '01159cfc-a4ca-4a08-b999-7401824ba2ea', 'e1e057d3-7751-46fc-92c5-49313a1ab25c'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:41:00.416096 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-145f77ad-ce91-4fb1-97ce-4dc14ab3ee03 tempest-VolumesBackupsTest-493584864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:00.467162 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-145f77ad-ce91-4fb1-97ce-4dc14ab3ee03 tempest-VolumesBackupsTest-493584864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:00.492689 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-145f77ad-ce91-4fb1-97ce-4dc14ab3ee03 tempest-VolumesBackupsTest-493584864 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:41:00.496860 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-145f77ad-ce91-4fb1-97ce-4dc14ab3ee03 tempest-VolumesBackupsTest-493584864 None] Deleted volume successfully.
Apr 16 21:41:00.562861 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-145f77ad-ce91-4fb1-97ce-4dc14ab3ee03 tempest-VolumesBackupsTest-493584864 None] Lock "b'cinder-e84da828-0f94-4f59-8e11-fac1f7cb4977-delete_volume'" released by "delete_volume" :: held 11.799s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:41:02.117956 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-cdd64cf8-7a6b-4f3d-80b9-bbdc893046d5 tempest-VolumesActionsTest-676127324 None] Created reservations ['b0099141-7b75-4e2d-b30e-5229e70f9389', '33db19be-e386-40c9-9a36-162feedae5ba', '4bd0c768-f959-499b-b5df-a6dc52260577', '25d67d69-3293-47f9-81ff-3b41d02fb286'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:41:02.303545 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cdd64cf8-7a6b-4f3d-80b9-bbdc893046d5 tempest-VolumesActionsTest-676127324 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:02.326168 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cdd64cf8-7a6b-4f3d-80b9-bbdc893046d5 tempest-VolumesActionsTest-676127324 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:02.348327 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-cdd64cf8-7a6b-4f3d-80b9-bbdc893046d5 tempest-VolumesActionsTest-676127324 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:41:02.352150 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cdd64cf8-7a6b-4f3d-80b9-bbdc893046d5 tempest-VolumesActionsTest-676127324 None] Deleted volume successfully.
Apr 16 21:41:02.421317 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-cdd64cf8-7a6b-4f3d-80b9-bbdc893046d5 tempest-VolumesActionsTest-676127324 None] Lock "b'cinder-2809aff5-2a43-49ab-8f25-c26d21f0ef41-delete_volume'" released by "delete_volume" :: held 7.266s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:41:03.496970 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:41:03.517739 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Flow 'volume_create_manager' (ac6c0ccb-a3ac-4166-b833-4b60960cce77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:41:03.524370 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91ca9ff-bcac-42c1-a13f-6b6c8e2ea65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:03.539555 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91ca9ff-bcac-42c1-a13f-6b6c8e2ea65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-463876714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=02c1cc60-ad7a-4163-8ab4-dacb38096e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96a293eac61499182c2a30c324d461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:41:03Z,use_quota=True,user_id='f6e4f0060ec44989882b3b21624cb87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:03.545077 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6b97a7-3945-4ccb-a42a-093a0f38fb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:03.549267 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6b97a7-3945-4ccb-a42a-093a0f38fb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:03.554973 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96005a2-6ab6-466d-b689-c5257d6cf215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:03.559092 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96005a2-6ab6-466d-b689-c5257d6cf215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02c1cc60-ad7a-4163-8ab4-dacb38096e89', 'volume_name': 'volume-02c1cc60-ad7a-4163-8ab4-dacb38096e89', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:03.564117 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f648eb-9cf1-4f6c-b3e2-a07216e23310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:03.568752 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f648eb-9cf1-4f6c-b3e2-a07216e23310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:03.573533 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab1dc58-8188-4079-a04e-66c8f787f2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:03.574621 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Volume 02c1cc60-ad7a-4163-8ab4-dacb38096e89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02c1cc60-ad7a-4163-8ab4-dacb38096e89', 'volume_size': 1}
Apr 16 21:41:03.575017 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] creating volume 'volume-02c1cc60-ad7a-4163-8ab4-dacb38096e89' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:41:03.575806 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:04.337723 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:41:04.338104 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:41:04.341878 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab1dc58-8188-4079-a04e-66c8f787f2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c1cc60-ad7a-4163-8ab4-dacb38096e89', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:04.346617 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2c1290-b84a-43d7-84e1-27ea8bb9793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:04.428687 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Volume volume-02c1cc60-ad7a-4163-8ab4-dacb38096e89 (02c1cc60-ad7a-4163-8ab4-dacb38096e89): created successfully
Apr 16 21:41:04.432417 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2c1290-b84a-43d7-84e1-27ea8bb9793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:04.438007 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Flow 'volume_create_manager' (ac6c0ccb-a3ac-4166-b833-4b60960cce77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:41:04.514757 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-373e749e-63fb-40dd-a02e-682b8a377e07 tempest-VolumesActionsTest-1967188215 None] Created volume successfully.
Apr 16 21:41:05.644916 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a056abf1-acc5-4803-a342-b6edbcb73095 tempest-VolumesActionsTest-676127324 None] Lock "b'cinder-02c1cc60-ad7a-4163-8ab4-dacb38096e89-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:41:05.872232 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a056abf1-acc5-4803-a342-b6edbcb73095 tempest-VolumesActionsTest-676127324 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:06.160049 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a056abf1-acc5-4803-a342-b6edbcb73095 tempest-VolumesActionsTest-676127324 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:41:06.160592 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a056abf1-acc5-4803-a342-b6edbcb73095 tempest-VolumesActionsTest-676127324 None] Volume volume-02c1cc60-ad7a-4163-8ab4-dacb38096e89 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:41:06.398222 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a056abf1-acc5-4803-a342-b6edbcb73095 tempest-VolumesActionsTest-676127324 None] deleting rbd volume volume-02c1cc60-ad7a-4163-8ab4-dacb38096e89 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:41:13.096920 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-a056abf1-acc5-4803-a342-b6edbcb73095 tempest-VolumesActionsTest-676127324 None] Created reservations ['c0b8bdbc-0d88-4ab4-9c8b-58ae6aeaec94', '27250f2c-0b41-49b8-954e-926174689ba5', '10b1702b-8781-43bc-9de7-83673ebee631', 'bc860c5c-4e1b-4e5b-9069-1575715ea435'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:41:13.360544 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a056abf1-acc5-4803-a342-b6edbcb73095 tempest-VolumesActionsTest-676127324 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:13.384640 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a056abf1-acc5-4803-a342-b6edbcb73095 tempest-VolumesActionsTest-676127324 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:13.410759 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-a056abf1-acc5-4803-a342-b6edbcb73095 tempest-VolumesActionsTest-676127324 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:41:13.414629 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a056abf1-acc5-4803-a342-b6edbcb73095 tempest-VolumesActionsTest-676127324 None] Deleted volume successfully.
Apr 16 21:41:13.476611 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a056abf1-acc5-4803-a342-b6edbcb73095 tempest-VolumesActionsTest-676127324 None] Lock "b'cinder-02c1cc60-ad7a-4163-8ab4-dacb38096e89-delete_volume'" released by "delete_volume" :: held 7.832s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:41:14.167592 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-cd5b9736-eb2e-4bd6-b6e7-9fc80c6033b4 tempest-VolumesBackupsTest-493584864 None] Lock "b'cinder-46ed5edf-8b2e-4f49-a9bc-d26d3e657685-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:41:14.266572 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cd5b9736-eb2e-4bd6-b6e7-9fc80c6033b4 tempest-VolumesBackupsTest-493584864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:16.566738 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cd5b9736-eb2e-4bd6-b6e7-9fc80c6033b4 tempest-VolumesBackupsTest-493584864 None] deleting rbd volume volume-46ed5edf-8b2e-4f49-a9bc-d26d3e657685 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:41:16.690359 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:41:16.710851 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Flow 'volume_create_manager' (ff398966-3459-451f-9c37-bfcdea471107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:41:16.717509 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea109052-fa98-42a0-b285-e8ba2d55087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:16.734227 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea109052-fa98-42a0-b285-e8ba2d55087a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1728989215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f379d7b-878d-4024-92f4-cbec5a4eaa81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96a293eac61499182c2a30c324d461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:41:15Z,use_quota=True,user_id='f6e4f0060ec44989882b3b21624cb87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:16.739857 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961baafe-358e-429e-8a04-c999768ae257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:16.744020 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961baafe-358e-429e-8a04-c999768ae257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:16.749250 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f28153c-41be-4395-8d78-a9094c947361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:16.753685 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f28153c-41be-4395-8d78-a9094c947361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f379d7b-878d-4024-92f4-cbec5a4eaa81', 'volume_name': 'volume-2f379d7b-878d-4024-92f4-cbec5a4eaa81', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:16.758759 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbf984c-13f3-446f-a71f-43d1a48baad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:16.762709 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbf984c-13f3-446f-a71f-43d1a48baad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:16.767479 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a289418c-eb44-4be3-990b-dd1f5a20529c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:16.768596 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Volume 2f379d7b-878d-4024-92f4-cbec5a4eaa81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f379d7b-878d-4024-92f4-cbec5a4eaa81', 'volume_size': 1}
Apr 16 21:41:16.768983 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] creating volume 'volume-2f379d7b-878d-4024-92f4-cbec5a4eaa81' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:41:16.770269 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:17.842290 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:41:17.842879 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:41:17.846407 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a289418c-eb44-4be3-990b-dd1f5a20529c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f379d7b-878d-4024-92f4-cbec5a4eaa81', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:17.851750 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5ec1cd-5f6d-497a-8082-022548b1436c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:17.945382 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Volume volume-2f379d7b-878d-4024-92f4-cbec5a4eaa81 (2f379d7b-878d-4024-92f4-cbec5a4eaa81): created successfully
Apr 16 21:41:17.949175 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5ec1cd-5f6d-497a-8082-022548b1436c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:17.955016 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Flow 'volume_create_manager' (ff398966-3459-451f-9c37-bfcdea471107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:41:18.060030 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7076722c-a17f-4e01-b184-712a9f8cb074 tempest-VolumesActionsTest-1967188215 None] Created volume successfully.
Apr 16 21:41:19.735371 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-321c6149-29db-4d59-8bd4-12f3d242dd21 tempest-VolumesActionsTest-1967188215 None] Lock "b'cinder-2f379d7b-878d-4024-92f4-cbec5a4eaa81-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:41:19.839286 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-321c6149-29db-4d59-8bd4-12f3d242dd21 tempest-VolumesActionsTest-1967188215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:20.031266 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-321c6149-29db-4d59-8bd4-12f3d242dd21 tempest-VolumesActionsTest-1967188215 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:41:20.031703 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-321c6149-29db-4d59-8bd4-12f3d242dd21 tempest-VolumesActionsTest-1967188215 None] Volume volume-2f379d7b-878d-4024-92f4-cbec5a4eaa81 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:41:20.168936 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-321c6149-29db-4d59-8bd4-12f3d242dd21 tempest-VolumesActionsTest-1967188215 None] deleting rbd volume volume-2f379d7b-878d-4024-92f4-cbec5a4eaa81 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:41:21.182758 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cd5b9736-eb2e-4bd6-b6e7-9fc80c6033b4 tempest-VolumesBackupsTest-493584864 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:41:21.388659 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cd5b9736-eb2e-4bd6-b6e7-9fc80c6033b4 tempest-VolumesBackupsTest-493584864 None] deleting parent snapshot volume-46ed5edf-8b2e-4f49-a9bc-d26d3e657685.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:41:24.991410 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-bec57f78-d2e4-4b35-b967-78ffe15f88a1 req-48d0afc7-42b7-416e-8541-8954c58975f2 tempest-AttachVolumeTestJSON-1623236864 None] Terminate volume connection completed successfully.
Apr 16 21:41:24.991966 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-bec57f78-d2e4-4b35-b967-78ffe15f88a1 req-48d0afc7-42b7-416e-8541-8954c58975f2 tempest-AttachVolumeTestJSON-1623236864 None] Deleting attachment 91f591e4-f556-432f-83fb-91d24f8976da. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:41:25.128521 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-cd5b9736-eb2e-4bd6-b6e7-9fc80c6033b4 tempest-VolumesBackupsTest-493584864 None] Created reservations ['4851bf05-b6f4-43ef-947a-1dc24b8d9ac2', '1a7dc830-07e7-4a37-b562-e3c3ace30a14', 'b236bf68-e2fb-4ae3-a349-8f3894ff0214', '6f9b8703-e39a-4ca6-a399-a6c41652dbdc'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:41:25.363109 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cd5b9736-eb2e-4bd6-b6e7-9fc80c6033b4 tempest-VolumesBackupsTest-493584864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:25.392278 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cd5b9736-eb2e-4bd6-b6e7-9fc80c6033b4 tempest-VolumesBackupsTest-493584864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:25.421403 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-cd5b9736-eb2e-4bd6-b6e7-9fc80c6033b4 tempest-VolumesBackupsTest-493584864 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:41:25.425384 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cd5b9736-eb2e-4bd6-b6e7-9fc80c6033b4 tempest-VolumesBackupsTest-493584864 None] Deleted volume successfully.
Apr 16 21:41:25.495617 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-cd5b9736-eb2e-4bd6-b6e7-9fc80c6033b4 tempest-VolumesBackupsTest-493584864 None] Lock "b'cinder-46ed5edf-8b2e-4f49-a9bc-d26d3e657685-delete_volume'" released by "delete_volume" :: held 11.328s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:41:26.379955 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-321c6149-29db-4d59-8bd4-12f3d242dd21 tempest-VolumesActionsTest-1967188215 None] Created reservations ['88ff6f5c-84bb-4630-9ffb-7e8b8f7aada8', '6cb5a704-5fd0-499e-ba66-cdd0f4f86993', 'a0b63948-a9aa-4eea-a3d9-a0235e02f972', 'd60c5ed0-9b7d-4112-b070-55f5688954f2'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:41:26.557056 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-321c6149-29db-4d59-8bd4-12f3d242dd21 tempest-VolumesActionsTest-1967188215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:26.585666 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-321c6149-29db-4d59-8bd4-12f3d242dd21 tempest-VolumesActionsTest-1967188215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:26.620815 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-321c6149-29db-4d59-8bd4-12f3d242dd21 tempest-VolumesActionsTest-1967188215 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:41:26.626576 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-321c6149-29db-4d59-8bd4-12f3d242dd21 tempest-VolumesActionsTest-1967188215 None] Deleted volume successfully.
Apr 16 21:41:26.733032 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-321c6149-29db-4d59-8bd4-12f3d242dd21 tempest-VolumesActionsTest-1967188215 None] Lock "b'cinder-2f379d7b-878d-4024-92f4-cbec5a4eaa81-delete_volume'" released by "delete_volume" :: held 6.998s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:41:27.406981 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f3e28907-a429-4fa1-b190-0d328d95d85c tempest-VolumesActionsTest-1967188215 None] Lock "b'cinder-ff57fde7-6edb-43ee-b977-bdc95436dafa-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:41:27.501762 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f3e28907-a429-4fa1-b190-0d328d95d85c tempest-VolumesActionsTest-1967188215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:27.633123 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f3e28907-a429-4fa1-b190-0d328d95d85c tempest-VolumesActionsTest-1967188215 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:41:27.633559 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f3e28907-a429-4fa1-b190-0d328d95d85c tempest-VolumesActionsTest-1967188215 None] Volume volume-ff57fde7-6edb-43ee-b977-bdc95436dafa is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:41:27.770888 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f3e28907-a429-4fa1-b190-0d328d95d85c tempest-VolumesActionsTest-1967188215 None] deleting rbd volume volume-ff57fde7-6edb-43ee-b977-bdc95436dafa {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:41:28.616987 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:41:28.617671 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:28.642941 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:28.667190 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:41:28.992414 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:41:29.013208 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Flow 'volume_create_manager' (9d64eadd-4c5b-432a-a05f-af1704d095a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:41:29.020009 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0745e6-81ea-48d0-a931-a20bbfce50ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:29.035752 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0745e6-81ea-48d0-a931-a20bbfce50ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-857139625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e6280940-4a9b-43d2-9492-55a297cf4ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af46d18991174f5bb9d8eb5232a96130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:41:29Z,use_quota=True,user_id='dd31543f72824cd99bfc598fe11d1b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:29.041839 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1024762b-92b7-4fac-a7a9-ed61fc6d2cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:29.046011 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1024762b-92b7-4fac-a7a9-ed61fc6d2cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:29.051148 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba01d459-1fc3-4da5-9341-0682922527ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:29.130897 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba01d459-1fc3-4da5-9341-0682922527ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e6280940-4a9b-43d2-9492-55a297cf4ab0', 'volume_name': 'volume-e6280940-4a9b-43d2-9492-55a297cf4ab0', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710a7dcd0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:29.136045 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7b5f26-f684-4d54-adea-8ac1dcc57f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:29.140070 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7b5f26-f684-4d54-adea-8ac1dcc57f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:29.144904 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256a51aa-b6cc-4260-8b78-b3f39c1c0344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:29.146016 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Volume e6280940-4a9b-43d2-9492-55a297cf4ab0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e6280940-4a9b-43d2-9492-55a297cf4ab0', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710a7dcd0>}
Apr 16 21:41:29.146593 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Cloning e6280940-4a9b-43d2-9492-55a297cf4ab0 from image 88bbe9a7-19d2-4102-9634-058b7c590848  at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 16 21:41:29.154278 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:41:29.256149 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 41, 29, 157952)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:41:29.258520 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:41:29.258520 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Found cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 16 21:41:29.261820 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" released by "_prepare_image_cache_entry" :: held 0.108s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:41:29.262757 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Attempting to retrieve cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 16 21:41:29.268460 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 41, 29, 266132)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:41:29.268930 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:41:29.269329 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Creating from source image-volume e0e222dd-75a5-4728-81e0-d352ad2a6247 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 16 21:41:29.281419 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:29.627459 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] creating snapshot='volume-e6280940-4a9b-43d2-9492-55a297cf4ab0.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:41:32.688857 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] cloning 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247@volume-e6280940-4a9b-43d2-9492-55a297cf4ab0.clone_snap' to 'volume-e6280940-4a9b-43d2-9492-55a297cf4ab0' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:41:33.162156 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-f3e28907-a429-4fa1-b190-0d328d95d85c tempest-VolumesActionsTest-1967188215 None] Created reservations ['b6066343-6dd1-486d-87a8-eca3781e6783', '9521fe9f-2c47-4043-bff5-f38229ce0ae8', '2f23002d-498a-4540-b289-8092dbfb934f', 'a5195178-d7bd-45f4-9d5c-168515b0b5b8'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:41:33.334172 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f3e28907-a429-4fa1-b190-0d328d95d85c tempest-VolumesActionsTest-1967188215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:33.355745 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f3e28907-a429-4fa1-b190-0d328d95d85c tempest-VolumesActionsTest-1967188215 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:33.380403 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-f3e28907-a429-4fa1-b190-0d328d95d85c tempest-VolumesActionsTest-1967188215 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:41:33.384985 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f3e28907-a429-4fa1-b190-0d328d95d85c tempest-VolumesActionsTest-1967188215 None] Deleted volume successfully.
Apr 16 21:41:33.470280 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f3e28907-a429-4fa1-b190-0d328d95d85c tempest-VolumesActionsTest-1967188215 None] Lock "b'cinder-ff57fde7-6edb-43ee-b977-bdc95436dafa-delete_volume'" released by "delete_volume" :: held 6.063s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:41:34.837686 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:41:34.839891 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:41:34.840312 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:41:35.610735 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:41:35.611718 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Marking volume e6280940-4a9b-43d2-9492-55a297cf4ab0 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:41:35.690334 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Copying metadata from image 88bbe9a7-19d2-4102-9634-058b7c590848 to e6280940-4a9b-43d2-9492-55a297cf4ab0. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 16 21:41:35.690878 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Creating volume glance metadata for volume e6280940-4a9b-43d2-9492-55a297cf4ab0 backed by image 88bbe9a7-19d2-4102-9634-058b7c590848 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 16 21:41:35.880543 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256a51aa-b6cc-4260-8b78-b3f39c1c0344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6280940-4a9b-43d2-9492-55a297cf4ab0', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710a7dcd0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:35.886387 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bd84f0-46dd-444c-9ed5-3519f16762c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:35.959007 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Volume volume-e6280940-4a9b-43d2-9492-55a297cf4ab0 (e6280940-4a9b-43d2-9492-55a297cf4ab0): created successfully
Apr 16 21:41:35.964045 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bd84f0-46dd-444c-9ed5-3519f16762c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:35.970410 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Flow 'volume_create_manager' (9d64eadd-4c5b-432a-a05f-af1704d095a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:41:36.039175 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3bd45b65-6651-4813-929f-c48e76befc8f tempest-VolumesExtendTest-959075109 None] Created volume successfully.
Apr 16 21:41:36.399856 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9158a7a-c13d-4a48-b999-8f310886bf4b tempest-VolumesExtendTest-959075109 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:38.989677 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9158a7a-c13d-4a48-b999-8f310886bf4b tempest-VolumesExtendTest-959075109 None] Extend volume from 1 GB to 2 GB. {{(pid=130674) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1874}}
Apr 16 21:41:39.227380 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b9158a7a-c13d-4a48-b999-8f310886bf4b tempest-VolumesExtendTest-959075109 None] Extend volume completed successfully.
Apr 16 21:41:40.653494 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:41:40.692331 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Flow 'volume_create_manager' (f2351691-58c1-470e-98c0-b87903a192ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:41:40.700836 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45606cd3-f2ff-49fd-a962-6f0412570ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:40.719887 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45606cd3-f2ff-49fd-a962-6f0412570ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-417253518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5fc46c30-7dfd-4c1c-afe5-c014c845f86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af46d18991174f5bb9d8eb5232a96130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:41:40Z,use_quota=True,user_id='dd31543f72824cd99bfc598fe11d1b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:40.726344 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83556e27-aae9-4445-815f-fca65e4db6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:40.734343 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83556e27-aae9-4445-815f-fca65e4db6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:40.739071 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45877f7-8477-4e28-8660-448792d47ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:40.744134 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45877f7-8477-4e28-8660-448792d47ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fc46c30-7dfd-4c1c-afe5-c014c845f86f', 'volume_name': 'volume-5fc46c30-7dfd-4c1c-afe5-c014c845f86f', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:40.749989 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d266708c-e8df-47e4-a426-65b78a7300d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:40.754557 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d266708c-e8df-47e4-a426-65b78a7300d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:40.765420 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d2d016-2e42-46b1-9ce3-5e75007107fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:40.766743 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Volume 5fc46c30-7dfd-4c1c-afe5-c014c845f86f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fc46c30-7dfd-4c1c-afe5-c014c845f86f', 'volume_size': 1}
Apr 16 21:41:40.767142 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] creating volume 'volume-5fc46c30-7dfd-4c1c-afe5-c014c845f86f' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:41:40.768330 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:41.628867 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:41:41.652441 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Flow 'volume_create_manager' (a7e112f0-0756-4b31-9715-8534a9cd0637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:41:41.658979 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6784e8-b25c-43fa-8151-a711daf5ba8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:41.674459 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6784e8-b25c-43fa-8151-a711daf5ba8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1930474291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=884773d1-e8f7-4293-8a1d-415282e7a5e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe1ec5cf4df4bae9108cf5eea4c5ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:41:41Z,use_quota=True,user_id='cf75a426d99d4262884afb6f577479c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:41.680062 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04fd073-a727-45f3-bd9c-4c4cdf4119d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:41.684379 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04fd073-a727-45f3-bd9c-4c4cdf4119d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:41.689704 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77222397-c069-4562-a9d3-20768c748518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:41.693840 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77222397-c069-4562-a9d3-20768c748518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '884773d1-e8f7-4293-8a1d-415282e7a5e3', 'volume_name': 'volume-884773d1-e8f7-4293-8a1d-415282e7a5e3', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:41.699325 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b8aef4-a63f-45c8-b532-f0943a4092c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:41.703291 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b8aef4-a63f-45c8-b532-f0943a4092c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:41.708050 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b8f494-a18f-471a-a55a-652fd6eb9ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:41.709299 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Volume 884773d1-e8f7-4293-8a1d-415282e7a5e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-884773d1-e8f7-4293-8a1d-415282e7a5e3', 'volume_size': 1}
Apr 16 21:41:41.713222 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] creating volume 'volume-884773d1-e8f7-4293-8a1d-415282e7a5e3' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:41:41.713222 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:42.119964 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:41:42.120724 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:41:42.124645 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d2d016-2e42-46b1-9ce3-5e75007107fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fc46c30-7dfd-4c1c-afe5-c014c845f86f', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:42.129855 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0289bf3-6814-4c2e-ab0d-87ac10fd4cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:42.207179 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Volume volume-5fc46c30-7dfd-4c1c-afe5-c014c845f86f (5fc46c30-7dfd-4c1c-afe5-c014c845f86f): created successfully
Apr 16 21:41:42.211093 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0289bf3-6814-4c2e-ab0d-87ac10fd4cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:42.216939 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Flow 'volume_create_manager' (f2351691-58c1-470e-98c0-b87903a192ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:41:42.275763 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-17a37964-1590-442c-a265-f597be8176cf tempest-VolumesExtendTest-959075109 None] Created volume successfully.
Apr 16 21:41:42.784625 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:41:42.785758 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:41:42.791286 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b8f494-a18f-471a-a55a-652fd6eb9ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-884773d1-e8f7-4293-8a1d-415282e7a5e3', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:42.795990 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4d2cab-f955-4c6c-b492-97cf8b06f52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:42.859289 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Volume volume-884773d1-e8f7-4293-8a1d-415282e7a5e3 (884773d1-e8f7-4293-8a1d-415282e7a5e3): created successfully
Apr 16 21:41:42.863228 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4d2cab-f955-4c6c-b492-97cf8b06f52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:42.873657 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Flow 'volume_create_manager' (a7e112f0-0756-4b31-9715-8534a9cd0637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:41:42.944998 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-213c9708-f068-43ba-be8e-e11d32e68b27 tempest-VolumesMetadataTest-1554443829 None] Created volume successfully.
Apr 16 21:41:43.143454 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1d495108-ad0a-4005-a439-e5704807f035 tempest-VolumesExtendTest-959075109 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:44.912955 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-aef18b24-ff43-4717-9bc6-5b6c6c211ed6 tempest-VolumesMetadataTest-1554443829 None] Lock "b'cinder-884773d1-e8f7-4293-8a1d-415282e7a5e3-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:41:45.014249 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aef18b24-ff43-4717-9bc6-5b6c6c211ed6 tempest-VolumesMetadataTest-1554443829 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:45.448352 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aef18b24-ff43-4717-9bc6-5b6c6c211ed6 tempest-VolumesMetadataTest-1554443829 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:41:45.448879 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aef18b24-ff43-4717-9bc6-5b6c6c211ed6 tempest-VolumesMetadataTest-1554443829 None] Volume volume-884773d1-e8f7-4293-8a1d-415282e7a5e3 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:41:45.702480 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aef18b24-ff43-4717-9bc6-5b6c6c211ed6 tempest-VolumesMetadataTest-1554443829 None] deleting rbd volume volume-884773d1-e8f7-4293-8a1d-415282e7a5e3 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:41:47.218569 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1d495108-ad0a-4005-a439-e5704807f035 tempest-VolumesExtendTest-959075109 None] Create snapshot completed successfully
Apr 16 21:41:48.393240 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-83dda2bf-5d5b-4848-92fc-a8a07988689c tempest-VolumesExtendTest-959075109 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:50.336649 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-83dda2bf-5d5b-4848-92fc-a8a07988689c tempest-VolumesExtendTest-959075109 None] Extend volume from 1 GB to 2 GB. {{(pid=130674) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1874}}
Apr 16 21:41:50.503911 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-83dda2bf-5d5b-4848-92fc-a8a07988689c tempest-VolumesExtendTest-959075109 None] Extend volume completed successfully.
Apr 16 21:41:51.752599 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-90f56e79-4276-4ec1-a9c9-bd7b9d1a126a tempest-VolumesExtendTest-959075109 None] Lock "b'cinder-e7883ab6-921d-4425-aa4c-4c9c15bfeda5-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:41:51.754650 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-90f56e79-4276-4ec1-a9c9-bd7b9d1a126a tempest-VolumesExtendTest-959075109 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:52.803878 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-aef18b24-ff43-4717-9bc6-5b6c6c211ed6 tempest-VolumesMetadataTest-1554443829 None] Created reservations ['a42b3ea3-e16e-4fb2-abed-4c221f44915e', '89a8c0b4-d655-4c96-848f-e9d1347f376e', '4bcf7108-b636-420b-b444-0059d835882f', '26d84319-0cd3-4ecd-9696-e00eb47d2a2d'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:41:53.021725 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aef18b24-ff43-4717-9bc6-5b6c6c211ed6 tempest-VolumesMetadataTest-1554443829 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:53.043539 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aef18b24-ff43-4717-9bc6-5b6c6c211ed6 tempest-VolumesMetadataTest-1554443829 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:53.064982 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-aef18b24-ff43-4717-9bc6-5b6c6c211ed6 tempest-VolumesMetadataTest-1554443829 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:41:53.069883 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-aef18b24-ff43-4717-9bc6-5b6c6c211ed6 tempest-VolumesMetadataTest-1554443829 None] Deleted volume successfully.
Apr 16 21:41:53.139337 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-aef18b24-ff43-4717-9bc6-5b6c6c211ed6 tempest-VolumesMetadataTest-1554443829 None] Lock "b'cinder-884773d1-e8f7-4293-8a1d-415282e7a5e3-delete_volume'" released by "delete_volume" :: held 8.226s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:41:54.892849 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-90f56e79-4276-4ec1-a9c9-bd7b9d1a126a tempest-VolumesExtendTest-959075109 None] Created reservations ['2912b827-d605-4147-adfd-c42c4af86198', '61196cdf-4a3d-4fb9-b9fa-62a323c4718d', '8a4d8d18-127c-45bc-b12c-d3d612d3e2b6', '72dc0eb4-2aa6-451a-a43e-c142877b504d'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:41:55.055094 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-90f56e79-4276-4ec1-a9c9-bd7b9d1a126a tempest-VolumesExtendTest-959075109 None] Delete snapshot completed successfully.
Apr 16 21:41:55.061094 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-90f56e79-4276-4ec1-a9c9-bd7b9d1a126a tempest-VolumesExtendTest-959075109 None] Lock "b'cinder-e7883ab6-921d-4425-aa4c-4c9c15bfeda5-delete_snapshot'" released by "delete_snapshot" :: held 3.309s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:41:56.190623 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5d0dd777-599d-4213-ad49-33a46b09b057 tempest-VolumesExtendTest-959075109 None] Lock "b'cinder-5fc46c30-7dfd-4c1c-afe5-c014c845f86f-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:41:56.330345 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5d0dd777-599d-4213-ad49-33a46b09b057 tempest-VolumesExtendTest-959075109 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:56.496377 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5d0dd777-599d-4213-ad49-33a46b09b057 tempest-VolumesExtendTest-959075109 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:41:56.496801 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5d0dd777-599d-4213-ad49-33a46b09b057 tempest-VolumesExtendTest-959075109 None] Volume volume-5fc46c30-7dfd-4c1c-afe5-c014c845f86f is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:41:56.707130 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5d0dd777-599d-4213-ad49-33a46b09b057 tempest-VolumesExtendTest-959075109 None] deleting rbd volume volume-5fc46c30-7dfd-4c1c-afe5-c014c845f86f {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:41:58.396525 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:41:58.418259 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Flow 'volume_create_manager' (4fa0acbe-8649-4d34-85af-8d540c963cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:41:58.424846 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb59f0b2-9f93-47d7-9966-e450df2da3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:58.439876 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb59f0b2-9f93-47d7-9966-e450df2da3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-322525690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b419c8ec-d8d6-495e-9cec-3da461c92db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda4f5ee41d2439e935ee0f658f465d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:41:58Z,use_quota=True,user_id='95bf99de7a594e209f995e62db441850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:58.445444 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2e0f67-24d9-4355-a75b-1c90fa4792bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:58.450214 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2e0f67-24d9-4355-a75b-1c90fa4792bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:58.455409 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb98155-ab27-4206-be5e-30cced1e2cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:58.459576 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb98155-ab27-4206-be5e-30cced1e2cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b419c8ec-d8d6-495e-9cec-3da461c92db9', 'volume_name': 'volume-b419c8ec-d8d6-495e-9cec-3da461c92db9', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:58.465694 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9dd8dc2-2aad-4532-9458-6fac621e341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:58.469707 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9dd8dc2-2aad-4532-9458-6fac621e341d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:58.474584 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85b636b-23ea-4e26-92a4-9eb22f1cccfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:58.475920 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Volume b419c8ec-d8d6-495e-9cec-3da461c92db9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b419c8ec-d8d6-495e-9cec-3da461c92db9', 'volume_size': 1}
Apr 16 21:41:58.476349 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] creating volume 'volume-b419c8ec-d8d6-495e-9cec-3da461c92db9' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:41:58.477171 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:41:59.429345 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:41:59.429977 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:41:59.433717 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85b636b-23ea-4e26-92a4-9eb22f1cccfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b419c8ec-d8d6-495e-9cec-3da461c92db9', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:59.438861 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f877d741-51b5-4636-b0e9-bbb7f7f6463d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:41:59.503574 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Volume volume-b419c8ec-d8d6-495e-9cec-3da461c92db9 (b419c8ec-d8d6-495e-9cec-3da461c92db9): created successfully
Apr 16 21:41:59.507484 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f877d741-51b5-4636-b0e9-bbb7f7f6463d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:41:59.513368 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Flow 'volume_create_manager' (4fa0acbe-8649-4d34-85af-8d540c963cfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:41:59.580579 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9f916217-cb8f-49d1-8012-cb64509d40de tempest-VolumesSnapshotTestJSON-2078807312 None] Created volume successfully.
Apr 16 21:42:00.909044 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-072e7f75-3756-427e-ab69-de6627d7b657 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:42:02.677882 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-5d0dd777-599d-4213-ad49-33a46b09b057 tempest-VolumesExtendTest-959075109 None] Created reservations ['d2e33a14-27c9-44db-8b00-f82d1f44d27b', '4497aa45-84cc-48b0-84bc-52e97c90051b', '70e82f46-1994-4b45-9656-30d8d45efc3c', '8a1d393a-6665-4bb6-979b-2ef3d7f4c371'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:42:02.884506 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5d0dd777-599d-4213-ad49-33a46b09b057 tempest-VolumesExtendTest-959075109 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:42:02.906112 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5d0dd777-599d-4213-ad49-33a46b09b057 tempest-VolumesExtendTest-959075109 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:42:02.930548 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-5d0dd777-599d-4213-ad49-33a46b09b057 tempest-VolumesExtendTest-959075109 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:42:02.935045 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5d0dd777-599d-4213-ad49-33a46b09b057 tempest-VolumesExtendTest-959075109 None] Deleted volume successfully.
Apr 16 21:42:02.996413 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5d0dd777-599d-4213-ad49-33a46b09b057 tempest-VolumesExtendTest-959075109 None] Lock "b'cinder-5fc46c30-7dfd-4c1c-afe5-c014c845f86f-delete_volume'" released by "delete_volume" :: held 6.811s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:42:03.793945 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f9688821-f227-4534-8acc-7b4d5939b362 tempest-VolumesExtendTest-959075109 None] Lock "b'cinder-e6280940-4a9b-43d2-9492-55a297cf4ab0-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:42:03.877203 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f9688821-f227-4534-8acc-7b4d5939b362 tempest-VolumesExtendTest-959075109 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:42:04.232059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f9688821-f227-4534-8acc-7b4d5939b362 tempest-VolumesExtendTest-959075109 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:42:04.461393 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f9688821-f227-4534-8acc-7b4d5939b362 tempest-VolumesExtendTest-959075109 None] deleting rbd volume volume-e6280940-4a9b-43d2-9492-55a297cf4ab0 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:42:04.546154 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-072e7f75-3756-427e-ab69-de6627d7b657 tempest-VolumesSnapshotTestJSON-2078807312 None] Create snapshot completed successfully
Apr 16 21:42:05.617771 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.driver [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] Creating a new backup for volume volume-b419c8ec-d8d6-495e-9cec-3da461c92db9. {{(pid=130674) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1212}}
Apr 16 21:42:05.739510 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] cloning volumes/volume-b419c8ec-d8d6-495e-9cec-3da461c92db9@snapshot-4201fdce-fcae-4c9c-856b-2507c4ae1a5c to volume-de773626-a602-4242-b991-bfa71523c235 {{(pid=130674) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}}
Apr 16 21:42:05.740313 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:42:05.775781 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:42:07.682049 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:42:07.682786 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:42:07.687275 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:42:07.744575 ncdv-master-1 cinder-volume[130674]: WARNING cinder.volume.drivers.rbd [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues
Apr 16 21:42:07.943365 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-16T21:42:05Z,data_timestamp=2022-04-16T21:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-1939402058',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=cf9d0423-efc6-4554-ac62-83484c45a336,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='cda4f5ee41d2439e935ee0f658f465d4',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='4201fdce-fcae-4c9c-856b-2507c4ae1a5c',status='creating',temp_snapshot_id=None,temp_volume_id='de773626-a602-4242-b991-bfa71523c235',updated_at=None,user_id='95bf99de7a594e209f995e62db441850',volume_id=b419c8ec-d8d6-495e-9cec-3da461c92db9)
Apr 16 21:42:07.944043 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.backup.rpcapi [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] continue_backup in rpcapi backup_id cf9d0423-efc6-4554-ac62-83484c45a336 {{(pid=130674) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Apr 16 21:42:08.061910 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:42:08.686494 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.624s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:42:08.687560 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-de773626-a602-4242-b991-bfa71523c235', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'de773626-a602-4242-b991-bfa71523c235', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:42:08.702921 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] Initialize volume connection completed successfully.
Apr 16 21:42:12.002565 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f9688821-f227-4534-8acc-7b4d5939b362 tempest-VolumesExtendTest-959075109 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:42:12.361584 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f9688821-f227-4534-8acc-7b4d5939b362 tempest-VolumesExtendTest-959075109 None] deleting parent snapshot volume-e6280940-4a9b-43d2-9492-55a297cf4ab0.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:42:17.777164 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-f9688821-f227-4534-8acc-7b4d5939b362 tempest-VolumesExtendTest-959075109 None] Created reservations ['6e659299-c8ce-4a77-8511-c6f272971dfd', 'c9c3e8df-7644-4bda-929b-5e6e51dde25b', '77482e47-de81-4bb8-ae21-a2d6d50e334c', '868e6b8e-eef0-4e8b-9f4f-63a242940b9f'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:42:17.980630 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f9688821-f227-4534-8acc-7b4d5939b362 tempest-VolumesExtendTest-959075109 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:42:18.035691 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f9688821-f227-4534-8acc-7b4d5939b362 tempest-VolumesExtendTest-959075109 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:42:18.067937 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-f9688821-f227-4534-8acc-7b4d5939b362 tempest-VolumesExtendTest-959075109 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:42:18.073169 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f9688821-f227-4534-8acc-7b4d5939b362 tempest-VolumesExtendTest-959075109 None] Deleted volume successfully.
Apr 16 21:42:18.171592 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f9688821-f227-4534-8acc-7b4d5939b362 tempest-VolumesExtendTest-959075109 None] Lock "b'cinder-e6280940-4a9b-43d2-9492-55a297cf4ab0-delete_volume'" released by "delete_volume" :: held 14.377s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:42:28.623008 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:42:28.624710 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:42:28.657519 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:42:28.692834 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:43:11.336306 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:43:11.362699 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Flow 'volume_create_manager' (fa43f5ad-5577-4dc8-a4c8-6e1816c258d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:43:11.370605 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4024331-0dc6-4775-8ed1-1dbac2ea1ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:43:11.393190 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4024331-0dc6-4775-8ed1-1dbac2ea1ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1617050935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ff535870-3c90-4727-bb5b-abf029d4dc9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fc33178ac5b4d4f9c1f346e3b4371b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:43:11Z,use_quota=True,user_id='8b67f0226ea247ae857b18891e0834f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:43:11.400081 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf920e6-d8dd-4750-95b1-4ef8cf0bc29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:43:11.404979 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf920e6-d8dd-4750-95b1-4ef8cf0bc29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:43:11.414059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755e8598-4479-49d7-a906-f377da69c5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:43:11.419256 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755e8598-4479-49d7-a906-f377da69c5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff535870-3c90-4727-bb5b-abf029d4dc9e', 'volume_name': 'volume-ff535870-3c90-4727-bb5b-abf029d4dc9e', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:43:11.428551 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f06cbd-f06a-4868-9c58-30f3a656eeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:43:11.434763 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f06cbd-f06a-4868-9c58-30f3a656eeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:43:11.439718 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6d514e-2e25-4dbe-a7a6-b123487a2951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:43:11.440890 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Volume ff535870-3c90-4727-bb5b-abf029d4dc9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff535870-3c90-4727-bb5b-abf029d4dc9e', 'volume_size': 1}
Apr 16 21:43:11.441288 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] creating volume 'volume-ff535870-3c90-4727-bb5b-abf029d4dc9e' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:43:11.442826 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:43:12.815058 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:43:12.815764 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:43:12.820383 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6d514e-2e25-4dbe-a7a6-b123487a2951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff535870-3c90-4727-bb5b-abf029d4dc9e', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:43:12.825893 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ec3029-4922-4d04-98b4-dbba04cbcae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:43:12.905632 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Volume volume-ff535870-3c90-4727-bb5b-abf029d4dc9e (ff535870-3c90-4727-bb5b-abf029d4dc9e): created successfully
Apr 16 21:43:12.909625 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ec3029-4922-4d04-98b4-dbba04cbcae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:43:12.915274 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Flow 'volume_create_manager' (fa43f5ad-5577-4dc8-a4c8-6e1816c258d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:43:12.992138 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-eb3b386f-fed7-499a-80ac-89767dc60da1 tempest-AttachVolumeTestJSON-1623236864 None] Created volume successfully.
Apr 16 21:43:13.657816 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-966e8f32-69f9-4de7-b277-6773779c5397 req-18d279bb-7ba0-400b-b680-3dc95e1245d6 tempest-TestVolumeBackupRestore-1675082881 None] Terminate volume connection completed successfully.
Apr 16 21:43:13.658446 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-966e8f32-69f9-4de7-b277-6773779c5397 req-18d279bb-7ba0-400b-b680-3dc95e1245d6 tempest-TestVolumeBackupRestore-1675082881 None] Deleting attachment 4cf305a4-12bc-4b4e-8c11-2846e4aa00d7. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:43:14.766861 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-2c7adacd-dded-432e-90b6-cb89fbb41216 req-eb5f1301-6309-4553-8bb8-23f5ac936445 tempest-AttachVolumeTestJSON-1623236864 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:43:15.429023 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-2c7adacd-dded-432e-90b6-cb89fbb41216 req-eb5f1301-6309-4553-8bb8-23f5ac936445 tempest-AttachVolumeTestJSON-1623236864 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.662s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:43:15.429892 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-2c7adacd-dded-432e-90b6-cb89fbb41216 req-eb5f1301-6309-4553-8bb8-23f5ac936445 tempest-AttachVolumeTestJSON-1623236864 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ff535870-3c90-4727-bb5b-abf029d4dc9e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'ff535870-3c90-4727-bb5b-abf029d4dc9e', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:43:15.544039 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-2c7adacd-dded-432e-90b6-cb89fbb41216 req-eb5f1301-6309-4553-8bb8-23f5ac936445 tempest-AttachVolumeTestJSON-1623236864 None] Connection info returned from driver {'name': 'volumes/volume-ff535870-3c90-4727-bb5b-abf029d4dc9e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ff535870-3c90-4727-bb5b-abf029d4dc9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7d7d9a00-fa25-4c0d-b1dd-a9f04193413e'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:43:15.684886 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-2c7adacd-dded-432e-90b6-cb89fbb41216 req-eb5f1301-6309-4553-8bb8-23f5ac936445 tempest-AttachVolumeTestJSON-1623236864 None] attachment_update completed successfully.
Apr 16 21:43:16.204962 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-54bee3b8-422e-441e-9515-14a38f2a5a61 tempest-TestVolumeBackupRestore-1675082881 None] Lock "b'cinder-9312ec94-740a-4dce-bd71-1c9d823af28d-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:43:16.307468 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-54bee3b8-422e-441e-9515-14a38f2a5a61 tempest-TestVolumeBackupRestore-1675082881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:43:21.070877 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-54bee3b8-422e-441e-9515-14a38f2a5a61 tempest-TestVolumeBackupRestore-1675082881 None] Volume volume-9312ec94-740a-4dce-bd71-1c9d823af28d is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:43:22.631230 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-54bee3b8-422e-441e-9515-14a38f2a5a61 tempest-TestVolumeBackupRestore-1675082881 None] deleting rbd volume volume-9312ec94-740a-4dce-bd71-1c9d823af28d {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:43:22.654598 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1c32ff9f-6876-40ad-a5e7-ae9c41a89cf7 tempest-TestVolumeBackupRestore-1675082881 None] Lock "b'cinder-2a52b0c3-1018-488f-bff4-8d3025861720-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:43:22.859481 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1c32ff9f-6876-40ad-a5e7-ae9c41a89cf7 tempest-TestVolumeBackupRestore-1675082881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:43:28.929869 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1c32ff9f-6876-40ad-a5e7-ae9c41a89cf7 tempest-TestVolumeBackupRestore-1675082881 None] deleting rbd volume volume-2a52b0c3-1018-488f-bff4-8d3025861720 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:43:28.932914 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:43:28.933554 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:43:28.954584 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:43:28.976388 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:43:29.094877 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:43:29.118510 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Flow 'volume_create_manager' (a2381622-090d-4ca8-a109-deb91ddcd4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:43:29.125538 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8beeeba-5d64-47e9-b6ae-46e8801c38f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:43:29.140878 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8beeeba-5d64-47e9-b6ae-46e8801c38f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1945898249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4648da5b-a470-426c-b3aa-189111891a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fc33178ac5b4d4f9c1f346e3b4371b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:43:26Z,use_quota=True,user_id='8b67f0226ea247ae857b18891e0834f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:43:29.146308 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec97358-eb4d-4c90-b663-f25e13289989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:43:29.150489 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec97358-eb4d-4c90-b663-f25e13289989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:43:29.156138 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3009e393-d7d0-4762-98c4-d3ee45c162f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:43:29.160386 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3009e393-d7d0-4762-98c4-d3ee45c162f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4648da5b-a470-426c-b3aa-189111891a4d', 'volume_name': 'volume-4648da5b-a470-426c-b3aa-189111891a4d', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:43:29.165414 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1640d189-cea7-4d68-b251-2543afcec119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:43:29.170017 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1640d189-cea7-4d68-b251-2543afcec119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:43:29.174764 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a05c17f-d77f-4ced-9401-17178bb5255e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:43:29.175854 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Volume 4648da5b-a470-426c-b3aa-189111891a4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4648da5b-a470-426c-b3aa-189111891a4d', 'volume_size': 1}
Apr 16 21:43:29.176275 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] creating volume 'volume-4648da5b-a470-426c-b3aa-189111891a4d' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:43:29.176944 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:43:33.273962 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:43:33.274673 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:43:33.278246 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a05c17f-d77f-4ced-9401-17178bb5255e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4648da5b-a470-426c-b3aa-189111891a4d', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:43:33.283063 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3981cca4-8e68-4ee9-a7be-3dd208e7ebe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:43:33.341894 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Volume volume-4648da5b-a470-426c-b3aa-189111891a4d (4648da5b-a470-426c-b3aa-189111891a4d): created successfully
Apr 16 21:43:33.345585 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3981cca4-8e68-4ee9-a7be-3dd208e7ebe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:43:33.351230 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Flow 'volume_create_manager' (a2381622-090d-4ca8-a109-deb91ddcd4c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:43:33.436645 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0b9fdba2-89c2-41cd-a7c4-4859af71dcf7 tempest-AttachVolumeTestJSON-1623236864 None] Created volume successfully.
Apr 16 21:43:34.968923 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-b6aa3216-7fd0-4173-bdb2-add0de3d76b7 req-b99ea3d2-a6fa-427d-9787-dd14e2767700 tempest-AttachVolumeTestJSON-1623236864 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:43:35.615503 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-b6aa3216-7fd0-4173-bdb2-add0de3d76b7 req-b99ea3d2-a6fa-427d-9787-dd14e2767700 tempest-AttachVolumeTestJSON-1623236864 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.646s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:43:35.617468 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-b6aa3216-7fd0-4173-bdb2-add0de3d76b7 req-b99ea3d2-a6fa-427d-9787-dd14e2767700 tempest-AttachVolumeTestJSON-1623236864 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4648da5b-a470-426c-b3aa-189111891a4d', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '4648da5b-a470-426c-b3aa-189111891a4d', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:43:35.727617 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-b6aa3216-7fd0-4173-bdb2-add0de3d76b7 req-b99ea3d2-a6fa-427d-9787-dd14e2767700 tempest-AttachVolumeTestJSON-1623236864 None] Connection info returned from driver {'name': 'volumes/volume-4648da5b-a470-426c-b3aa-189111891a4d', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4648da5b-a470-426c-b3aa-189111891a4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'aa54168d-b291-4a7d-9f1d-54a06a3dd7ee'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:43:35.864194 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-b6aa3216-7fd0-4173-bdb2-add0de3d76b7 req-b99ea3d2-a6fa-427d-9787-dd14e2767700 tempest-AttachVolumeTestJSON-1623236864 None] attachment_update completed successfully.
Apr 16 21:43:38.761881 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-54bee3b8-422e-441e-9515-14a38f2a5a61 tempest-TestVolumeBackupRestore-1675082881 None] Created reservations ['8887b039-6ab3-48db-ae03-c79420be57fd', 'cd1fc20f-787f-48fc-83e1-4676500b412b', '6e56b484-113e-4666-bb24-894fecf41003', '470ef98e-9c07-4327-a069-42373f8317d2'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:43:38.979696 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-54bee3b8-422e-441e-9515-14a38f2a5a61 tempest-TestVolumeBackupRestore-1675082881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:43:39.007062 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-54bee3b8-422e-441e-9515-14a38f2a5a61 tempest-TestVolumeBackupRestore-1675082881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:43:39.030951 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-54bee3b8-422e-441e-9515-14a38f2a5a61 tempest-TestVolumeBackupRestore-1675082881 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:43:39.035203 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-54bee3b8-422e-441e-9515-14a38f2a5a61 tempest-TestVolumeBackupRestore-1675082881 None] Deleted volume successfully.
Apr 16 21:43:39.140080 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-54bee3b8-422e-441e-9515-14a38f2a5a61 tempest-TestVolumeBackupRestore-1675082881 None] Lock "b'cinder-9312ec94-740a-4dce-bd71-1c9d823af28d-delete_volume'" released by "delete_volume" :: held 22.935s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:43:40.134390 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1c32ff9f-6876-40ad-a5e7-ae9c41a89cf7 tempest-TestVolumeBackupRestore-1675082881 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:43:40.742927 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1c32ff9f-6876-40ad-a5e7-ae9c41a89cf7 tempest-TestVolumeBackupRestore-1675082881 None] deleting parent snapshot volume-2a52b0c3-1018-488f-bff4-8d3025861720.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:43:44.962609 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-f3e7f794-61af-47ce-b7c3-16d27d10f8e4 req-78ba5341-aace-45ba-a847-d805d57b846d tempest-AttachVolumeTestJSON-1623236864 None] Terminate volume connection completed successfully.
Apr 16 21:43:44.963200 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-f3e7f794-61af-47ce-b7c3-16d27d10f8e4 req-78ba5341-aace-45ba-a847-d805d57b846d tempest-AttachVolumeTestJSON-1623236864 None] Deleting attachment 7d7d9a00-fa25-4c0d-b1dd-a9f04193413e. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:43:44.978380 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] Terminate volume connection completed successfully.
Apr 16 21:43:45.001719 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] Remove volume export completed successfully.
Apr 16 21:43:45.035761 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-de773626-a602-4242-b991-bfa71523c235-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:43:45.048211 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:43:45.206997 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:43:45.351076 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] deleting rbd volume volume-de773626-a602-4242-b991-bfa71523c235 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:43:45.354159 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-1c32ff9f-6876-40ad-a5e7-ae9c41a89cf7 tempest-TestVolumeBackupRestore-1675082881 None] Created reservations ['465e74ad-b8c0-4a4f-b98e-0cc606dbf425', 'bd3cd562-8bff-4805-9c70-ccd8c07a637d', 'bf874a6c-51a2-4016-87df-cbc463f17233', 'a4e895ce-0b29-49c3-adbb-2a77bd82ee57'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:43:45.573341 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1c32ff9f-6876-40ad-a5e7-ae9c41a89cf7 tempest-TestVolumeBackupRestore-1675082881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:43:45.595341 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1c32ff9f-6876-40ad-a5e7-ae9c41a89cf7 tempest-TestVolumeBackupRestore-1675082881 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:43:45.625565 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-1c32ff9f-6876-40ad-a5e7-ae9c41a89cf7 tempest-TestVolumeBackupRestore-1675082881 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:43:45.630322 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1c32ff9f-6876-40ad-a5e7-ae9c41a89cf7 tempest-TestVolumeBackupRestore-1675082881 None] Deleted volume successfully.
Apr 16 21:43:45.674794 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1c32ff9f-6876-40ad-a5e7-ae9c41a89cf7 tempest-TestVolumeBackupRestore-1675082881 None] Lock "b'cinder-2a52b0c3-1018-488f-bff4-8d3025861720-delete_volume'" released by "delete_volume" :: held 23.020s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:43:47.121606 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-7e19c252-91aa-4472-969a-05ae73655d7e req-fa90f40b-6363-46a6-9c50-4b438c3a4af1 tempest-AttachVolumeTestJSON-1623236864 None] Terminate volume connection completed successfully.
Apr 16 21:43:47.122194 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-7e19c252-91aa-4472-969a-05ae73655d7e req-fa90f40b-6363-46a6-9c50-4b438c3a4af1 tempest-AttachVolumeTestJSON-1623236864 None] Deleting attachment aa54168d-b291-4a7d-9f1d-54a06a3dd7ee. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:43:51.244798 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] Deleted volume successfully.
Apr 16 21:43:51.253081 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-897539d2-32f9-4295-b94c-259fce1118d3 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-de773626-a602-4242-b991-bfa71523c235-delete_volume'" released by "delete_volume" :: held 6.217s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:43:54.430435 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-e1a91ae9-1137-42cc-a608-350115fba9fa tempest-AttachVolumeTestJSON-1623236864 None] Lock "b'cinder-4648da5b-a470-426c-b3aa-189111891a4d-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:43:54.519324 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e1a91ae9-1137-42cc-a608-350115fba9fa tempest-AttachVolumeTestJSON-1623236864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:43:54.692255 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e1a91ae9-1137-42cc-a608-350115fba9fa tempest-AttachVolumeTestJSON-1623236864 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:43:54.696949 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e1a91ae9-1137-42cc-a608-350115fba9fa tempest-AttachVolumeTestJSON-1623236864 None] Volume volume-4648da5b-a470-426c-b3aa-189111891a4d is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:43:54.921904 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e1a91ae9-1137-42cc-a608-350115fba9fa tempest-AttachVolumeTestJSON-1623236864 None] deleting rbd volume volume-4648da5b-a470-426c-b3aa-189111891a4d {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:44:01.118465 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-e1a91ae9-1137-42cc-a608-350115fba9fa tempest-AttachVolumeTestJSON-1623236864 None] Created reservations ['80779e22-fa47-4681-b2ae-5697fb0db78d', '678f9d0a-da9a-4a01-8876-61ecd3adbe46', 'fbefec65-8358-46d1-abac-5bc7e0573f4f', '1424cdf3-a392-43a5-9cee-ef2cc77e69fa'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:44:01.281205 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e1a91ae9-1137-42cc-a608-350115fba9fa tempest-AttachVolumeTestJSON-1623236864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:01.305299 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e1a91ae9-1137-42cc-a608-350115fba9fa tempest-AttachVolumeTestJSON-1623236864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:01.330534 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-e1a91ae9-1137-42cc-a608-350115fba9fa tempest-AttachVolumeTestJSON-1623236864 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:44:01.334860 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e1a91ae9-1137-42cc-a608-350115fba9fa tempest-AttachVolumeTestJSON-1623236864 None] Deleted volume successfully.
Apr 16 21:44:01.410917 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-e1a91ae9-1137-42cc-a608-350115fba9fa tempest-AttachVolumeTestJSON-1623236864 None] Lock "b'cinder-4648da5b-a470-426c-b3aa-189111891a4d-delete_volume'" released by "delete_volume" :: held 6.980s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:44:02.038933 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-975ff667-f59e-4ac4-8edd-deb5cca64ec5 tempest-AttachVolumeTestJSON-1623236864 None] Lock "b'cinder-ff535870-3c90-4727-bb5b-abf029d4dc9e-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:44:02.154800 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-975ff667-f59e-4ac4-8edd-deb5cca64ec5 tempest-AttachVolumeTestJSON-1623236864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:02.277775 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-975ff667-f59e-4ac4-8edd-deb5cca64ec5 tempest-AttachVolumeTestJSON-1623236864 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:44:02.278302 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-975ff667-f59e-4ac4-8edd-deb5cca64ec5 tempest-AttachVolumeTestJSON-1623236864 None] Volume volume-ff535870-3c90-4727-bb5b-abf029d4dc9e is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:44:02.398492 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-975ff667-f59e-4ac4-8edd-deb5cca64ec5 tempest-AttachVolumeTestJSON-1623236864 None] deleting rbd volume volume-ff535870-3c90-4727-bb5b-abf029d4dc9e {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:44:05.920977 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-975ff667-f59e-4ac4-8edd-deb5cca64ec5 tempest-AttachVolumeTestJSON-1623236864 None] Created reservations ['caad27e4-2102-4054-87d4-ff0ba42be49c', 'b1e9bd52-443d-45b4-bdcf-0e9024270068', '817f010f-8432-4ef9-b856-513f5ef24e51', 'e1134b66-993a-4990-bd73-4729e87c7848'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:44:06.090160 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-975ff667-f59e-4ac4-8edd-deb5cca64ec5 tempest-AttachVolumeTestJSON-1623236864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:06.137766 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-975ff667-f59e-4ac4-8edd-deb5cca64ec5 tempest-AttachVolumeTestJSON-1623236864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:06.162240 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-975ff667-f59e-4ac4-8edd-deb5cca64ec5 tempest-AttachVolumeTestJSON-1623236864 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:44:06.166258 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-975ff667-f59e-4ac4-8edd-deb5cca64ec5 tempest-AttachVolumeTestJSON-1623236864 None] Deleted volume successfully.
Apr 16 21:44:06.286236 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-975ff667-f59e-4ac4-8edd-deb5cca64ec5 tempest-AttachVolumeTestJSON-1623236864 None] Lock "b'cinder-ff535870-3c90-4727-bb5b-abf029d4dc9e-delete_volume'" released by "delete_volume" :: held 4.247s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:44:06.524057 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5c5def50-713c-41e8-ab0e-6556d35af959 tempest-AttachVolumeTestJSON-1623236864 None] Lock "b'cinder-c83e6b4d-92b1-4775-8ed2-19365c945f19-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:44:06.621799 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5c5def50-713c-41e8-ab0e-6556d35af959 tempest-AttachVolumeTestJSON-1623236864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:06.786219 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5c5def50-713c-41e8-ab0e-6556d35af959 tempest-AttachVolumeTestJSON-1623236864 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:44:06.786594 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5c5def50-713c-41e8-ab0e-6556d35af959 tempest-AttachVolumeTestJSON-1623236864 None] Volume volume-c83e6b4d-92b1-4775-8ed2-19365c945f19 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:44:06.901019 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5c5def50-713c-41e8-ab0e-6556d35af959 tempest-AttachVolumeTestJSON-1623236864 None] deleting rbd volume volume-c83e6b4d-92b1-4775-8ed2-19365c945f19 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:44:10.091870 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-5c5def50-713c-41e8-ab0e-6556d35af959 tempest-AttachVolumeTestJSON-1623236864 None] Created reservations ['5b3a3d0c-c10d-4f55-b2a0-bb91816ab216', '327e0a60-58cb-48cd-af83-7d88d4e3c996', '3e0d2096-ddf2-4622-a136-21b841b773a2', 'af425dd2-894c-4d76-ae8f-a0b8fa774b5d'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:44:10.274940 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5c5def50-713c-41e8-ab0e-6556d35af959 tempest-AttachVolumeTestJSON-1623236864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:10.303208 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5c5def50-713c-41e8-ab0e-6556d35af959 tempest-AttachVolumeTestJSON-1623236864 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:10.330474 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-5c5def50-713c-41e8-ab0e-6556d35af959 tempest-AttachVolumeTestJSON-1623236864 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:44:10.335574 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5c5def50-713c-41e8-ab0e-6556d35af959 tempest-AttachVolumeTestJSON-1623236864 None] Deleted volume successfully.
Apr 16 21:44:10.434443 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5c5def50-713c-41e8-ab0e-6556d35af959 tempest-AttachVolumeTestJSON-1623236864 None] Lock "b'cinder-c83e6b4d-92b1-4775-8ed2-19365c945f19-delete_volume'" released by "delete_volume" :: held 3.909s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:44:13.358753 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:44:13.379667 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Flow 'volume_create_manager' (51e1d47a-faf3-4933-8ab1-a41d7d4893f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:44:13.386369 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152aad22-9d16-4318-9e36-7b927a707d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:44:13.404486 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152aad22-9d16-4318-9e36-7b927a707d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-940118664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fedcef50-29c9-4c19-a9b4-b678f9441c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda4f5ee41d2439e935ee0f658f465d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:44:13Z,use_quota=True,user_id='95bf99de7a594e209f995e62db441850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:44:13.410110 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ca131c-59ce-46e8-88f3-ab44f163e113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:44:13.414291 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ca131c-59ce-46e8-88f3-ab44f163e113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:44:13.422276 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aca4a09-2a98-4182-8fbd-099bc5bb2bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:44:13.514998 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aca4a09-2a98-4182-8fbd-099bc5bb2bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fedcef50-29c9-4c19-a9b4-b678f9441c3f', 'volume_name': 'volume-fedcef50-29c9-4c19-a9b4-b678f9441c3f', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710993880>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:44:13.520645 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d7666c-c488-45a5-bf8e-c73be045a122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:44:13.524716 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d7666c-c488-45a5-bf8e-c73be045a122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:44:13.530377 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193f764e-0aee-4a99-be79-dc2f22a2f7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:44:13.531676 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Volume fedcef50-29c9-4c19-a9b4-b678f9441c3f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fedcef50-29c9-4c19-a9b4-b678f9441c3f', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710993880>}
Apr 16 21:44:13.532294 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Cloning fedcef50-29c9-4c19-a9b4-b678f9441c3f from image 88bbe9a7-19d2-4102-9634-058b7c590848  at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 16 21:44:13.540700 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:44:13.614930 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 44, 13, 544337)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:44:13.618776 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:44:13.618776 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Found cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 16 21:44:13.620807 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" released by "_prepare_image_cache_entry" :: held 0.080s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:44:13.621744 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Attempting to retrieve cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 16 21:44:13.628667 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 44, 13, 625812)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:44:13.629094 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:44:13.629499 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Creating from source image-volume e0e222dd-75a5-4728-81e0-d352ad2a6247 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 16 21:44:13.640903 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:13.823241 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] creating snapshot='volume-fedcef50-29c9-4c19-a9b4-b678f9441c3f.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:44:15.035263 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] cloning 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247@volume-fedcef50-29c9-4c19-a9b4-b678f9441c3f.clone_snap' to 'volume-fedcef50-29c9-4c19-a9b4-b678f9441c3f' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:44:16.144523 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:44:16.145715 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:44:16.146095 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:44:16.504966 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:44:16.505520 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Marking volume fedcef50-29c9-4c19-a9b4-b678f9441c3f as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:44:16.574917 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Copying metadata from image 88bbe9a7-19d2-4102-9634-058b7c590848 to fedcef50-29c9-4c19-a9b4-b678f9441c3f. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 16 21:44:16.575340 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Creating volume glance metadata for volume fedcef50-29c9-4c19-a9b4-b678f9441c3f backed by image 88bbe9a7-19d2-4102-9634-058b7c590848 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 16 21:44:16.787364 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193f764e-0aee-4a99-be79-dc2f22a2f7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fedcef50-29c9-4c19-a9b4-b678f9441c3f', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710993880>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:44:16.792043 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31d18d3-8af6-4579-9d9a-e7b837f64592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:44:16.897237 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Volume volume-fedcef50-29c9-4c19-a9b4-b678f9441c3f (fedcef50-29c9-4c19-a9b4-b678f9441c3f): created successfully
Apr 16 21:44:16.901092 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31d18d3-8af6-4579-9d9a-e7b837f64592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:44:16.906629 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Flow 'volume_create_manager' (51e1d47a-faf3-4933-8ab1-a41d7d4893f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:44:17.000974 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-85724bcb-8d57-4397-94d6-b5a8c208300e tempest-VolumesSnapshotTestJSON-2078807312 None] Created volume successfully.
Apr 16 21:44:17.319425 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:44:17.339151 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Flow 'volume_create_manager' (d3f7bb0e-2e79-4942-9740-be2717db18f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:44:17.345892 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cf9763-fcc2-4916-95c9-42702d778516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:44:17.361202 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cf9763-fcc2-4916-95c9-42702d778516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1872605079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fec8a94a-52da-4bca-82d0-aa3da71ef967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c047382ac5554bbcaa40e70506123872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:44:17Z,use_quota=True,user_id='938638437d5f4521aabc7d1a16d925b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:44:17.367100 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60091f83-0ca5-4e3c-8bad-4b583adb2b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:44:17.371584 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60091f83-0ca5-4e3c-8bad-4b583adb2b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:44:17.376741 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d20bd6-a9bd-434c-a20a-a0035bb58fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:44:17.381458 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d20bd6-a9bd-434c-a20a-a0035bb58fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fec8a94a-52da-4bca-82d0-aa3da71ef967', 'volume_name': 'volume-fec8a94a-52da-4bca-82d0-aa3da71ef967', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:44:17.386451 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272306f4-faa3-4177-bf21-577375f07e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:44:17.390371 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272306f4-faa3-4177-bf21-577375f07e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:44:17.395133 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5146c7af-7c3b-49bf-bd20-381a69b96e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:44:17.396895 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Volume fec8a94a-52da-4bca-82d0-aa3da71ef967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fec8a94a-52da-4bca-82d0-aa3da71ef967', 'volume_size': 1}
Apr 16 21:44:17.396895 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] creating volume 'volume-fec8a94a-52da-4bca-82d0-aa3da71ef967' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:44:17.397479 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:17.914873 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:44:17.915260 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:44:17.919114 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5146c7af-7c3b-49bf-bd20-381a69b96e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fec8a94a-52da-4bca-82d0-aa3da71ef967', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:44:17.923751 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d253e5d7-6c3e-4aed-ad77-9e5599f9054a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:44:17.986486 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Volume volume-fec8a94a-52da-4bca-82d0-aa3da71ef967 (fec8a94a-52da-4bca-82d0-aa3da71ef967): created successfully
Apr 16 21:44:17.990244 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d253e5d7-6c3e-4aed-ad77-9e5599f9054a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:44:17.996075 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Flow 'volume_create_manager' (d3f7bb0e-2e79-4942-9740-be2717db18f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:44:18.097458 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-08f26616-d803-45d8-9aa0-001536ae6ba0 req-c6061c35-914f-4006-a9a5-2f9e0cbe4bbc tempest-VolumesSnapshotsTestJSON-1826452390 None] Created volume successfully.
Apr 16 21:44:18.257240 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-0eec4c1d-f8d5-471f-bc2c-ccc4c638dc8e req-2aa14fb4-97be-408c-af41-0b9c62e5178f tempest-VolumesSnapshotTestJSON-2078807312 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:44:18.715825 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-9f9faf31-b862-4564-9baa-3d295e138124 req-da3d81ae-4f6d-4933-a64a-9b4a1406f6f5 tempest-VolumesSnapshotsTestJSON-1826452390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:18.911625 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-0eec4c1d-f8d5-471f-bc2c-ccc4c638dc8e req-2aa14fb4-97be-408c-af41-0b9c62e5178f tempest-VolumesSnapshotTestJSON-2078807312 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.654s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:44:18.912296 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-0eec4c1d-f8d5-471f-bc2c-ccc4c638dc8e req-2aa14fb4-97be-408c-af41-0b9c62e5178f tempest-VolumesSnapshotTestJSON-2078807312 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fedcef50-29c9-4c19-a9b4-b678f9441c3f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'fedcef50-29c9-4c19-a9b4-b678f9441c3f', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:44:19.017381 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-0eec4c1d-f8d5-471f-bc2c-ccc4c638dc8e req-2aa14fb4-97be-408c-af41-0b9c62e5178f tempest-VolumesSnapshotTestJSON-2078807312 None] Connection info returned from driver {'name': 'volumes/volume-fedcef50-29c9-4c19-a9b4-b678f9441c3f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fedcef50-29c9-4c19-a9b4-b678f9441c3f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9c30d11b-a5ff-45b8-a541-bf1dd0aedb75'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:44:19.119659 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-0eec4c1d-f8d5-471f-bc2c-ccc4c638dc8e req-2aa14fb4-97be-408c-af41-0b9c62e5178f tempest-VolumesSnapshotTestJSON-2078807312 None] attachment_update completed successfully.
Apr 16 21:44:21.203974 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-9f9faf31-b862-4564-9baa-3d295e138124 req-da3d81ae-4f6d-4933-a64a-9b4a1406f6f5 tempest-VolumesSnapshotsTestJSON-1826452390 None] Create snapshot completed successfully
Apr 16 21:44:21.896902 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2a724c95-2823-4dfd-b339-9265b2ecb25b tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:22.079502 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-d60ab4df-27b3-4dcb-8667-3aa0d3057ee3 req-abaf1336-395a-4022-9bd8-acbf4758654f tempest-VolumesSnapshotsTestJSON-1826452390 None] Lock "b'cinder-265fd1cf-7727-4f40-97a4-a84abf780641-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:44:22.080993 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-d60ab4df-27b3-4dcb-8667-3aa0d3057ee3 req-abaf1336-395a-4022-9bd8-acbf4758654f tempest-VolumesSnapshotsTestJSON-1826452390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:24.862684 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-d60ab4df-27b3-4dcb-8667-3aa0d3057ee3 req-abaf1336-395a-4022-9bd8-acbf4758654f tempest-VolumesSnapshotsTestJSON-1826452390 None] Created reservations ['74c7e029-7756-4101-9216-1814aab4b2fb', '43a54a9d-f499-416d-adb3-dbbdb71850c7', 'f6ba3da0-a009-48eb-ba37-652f7bd750ab', '479758cb-28b9-4db9-b026-3c42db57cef1'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:44:25.048161 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2a724c95-2823-4dfd-b339-9265b2ecb25b tempest-VolumesSnapshotTestJSON-2078807312 None] Create snapshot completed successfully
Apr 16 21:44:25.134745 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-d60ab4df-27b3-4dcb-8667-3aa0d3057ee3 req-abaf1336-395a-4022-9bd8-acbf4758654f tempest-VolumesSnapshotsTestJSON-1826452390 None] Delete snapshot completed successfully.
Apr 16 21:44:25.139738 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-d60ab4df-27b3-4dcb-8667-3aa0d3057ee3 req-abaf1336-395a-4022-9bd8-acbf4758654f tempest-VolumesSnapshotsTestJSON-1826452390 None] Lock "b'cinder-265fd1cf-7727-4f40-97a4-a84abf780641-delete_snapshot'" released by "delete_snapshot" :: held 3.060s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:44:25.343706 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-bad15ad2-5ba5-47a9-895e-90ff7bdf43db req-a5979e7c-831f-474f-acf9-4d9f342762e7 tempest-VolumesSnapshotsTestJSON-1826452390 None] Lock "b'cinder-fec8a94a-52da-4bca-82d0-aa3da71ef967-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:44:25.441126 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-bad15ad2-5ba5-47a9-895e-90ff7bdf43db req-a5979e7c-831f-474f-acf9-4d9f342762e7 tempest-VolumesSnapshotsTestJSON-1826452390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:25.574268 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-bad15ad2-5ba5-47a9-895e-90ff7bdf43db req-a5979e7c-831f-474f-acf9-4d9f342762e7 tempest-VolumesSnapshotsTestJSON-1826452390 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:44:25.574648 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-bad15ad2-5ba5-47a9-895e-90ff7bdf43db req-a5979e7c-831f-474f-acf9-4d9f342762e7 tempest-VolumesSnapshotsTestJSON-1826452390 None] Volume volume-fec8a94a-52da-4bca-82d0-aa3da71ef967 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:44:25.708853 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-bad15ad2-5ba5-47a9-895e-90ff7bdf43db req-a5979e7c-831f-474f-acf9-4d9f342762e7 tempest-VolumesSnapshotsTestJSON-1826452390 None] deleting rbd volume volume-fec8a94a-52da-4bca-82d0-aa3da71ef967 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:44:26.432341 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-506b5b04-1aab-4388-8b43-b0de9dc0911c tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:28.937389 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:44:28.942059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:29.016759 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:29.087418 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:44:29.582873 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-506b5b04-1aab-4388-8b43-b0de9dc0911c tempest-VolumesSnapshotTestJSON-2078807312 None] Create snapshot completed successfully
Apr 16 21:44:30.434592 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-bad15ad2-5ba5-47a9-895e-90ff7bdf43db req-a5979e7c-831f-474f-acf9-4d9f342762e7 tempest-VolumesSnapshotsTestJSON-1826452390 None] Created reservations ['d0842216-5d17-4bb8-8f60-e47c825a9f08', 'ae3e5e4b-6cda-4a0f-aef5-d9af78385571', '8243699b-e875-433d-8a25-0551435940b4', '71a52a42-f756-4561-a5c8-c830a33adcc0'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:44:30.781832 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-bad15ad2-5ba5-47a9-895e-90ff7bdf43db req-a5979e7c-831f-474f-acf9-4d9f342762e7 tempest-VolumesSnapshotsTestJSON-1826452390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:30.905679 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-bad15ad2-5ba5-47a9-895e-90ff7bdf43db req-a5979e7c-831f-474f-acf9-4d9f342762e7 tempest-VolumesSnapshotsTestJSON-1826452390 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:30.997599 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-bad15ad2-5ba5-47a9-895e-90ff7bdf43db req-a5979e7c-831f-474f-acf9-4d9f342762e7 tempest-VolumesSnapshotsTestJSON-1826452390 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:44:31.007110 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-bad15ad2-5ba5-47a9-895e-90ff7bdf43db req-a5979e7c-831f-474f-acf9-4d9f342762e7 tempest-VolumesSnapshotsTestJSON-1826452390 None] Deleted volume successfully.
Apr 16 21:44:31.095437 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-bad15ad2-5ba5-47a9-895e-90ff7bdf43db req-a5979e7c-831f-474f-acf9-4d9f342762e7 tempest-VolumesSnapshotsTestJSON-1826452390 None] Lock "b'cinder-fec8a94a-52da-4bca-82d0-aa3da71ef967-delete_volume'" released by "delete_volume" :: held 5.752s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:44:31.253936 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7f45d650-1508-46e2-971f-8d7547d6d790 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:44:33.100217 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7f45d650-1508-46e2-971f-8d7547d6d790 tempest-VolumesSnapshotTestJSON-2078807312 None] Create snapshot completed successfully
Apr 16 21:44:34.295465 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-43708879-1714-4e74-85ec-ec22be975982 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-006a9c07-6908-4891-8667-8182437cf3c4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:44:34.297996 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-43708879-1714-4e74-85ec-ec22be975982 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:45:05.364266 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-43708879-1714-4e74-85ec-ec22be975982 tempest-VolumesSnapshotTestJSON-2078807312 None] Created reservations ['73b25c91-af61-4b93-81b9-42a1774cc9d0', '08bc83ec-4291-424d-9e28-7fd81b702aad', '4440bdae-bd14-4970-a294-9f3e4a34d72b', '7b9d5a39-38fd-4b2b-a172-ff416634e682'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:45:05.609835 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-43708879-1714-4e74-85ec-ec22be975982 tempest-VolumesSnapshotTestJSON-2078807312 None] Delete snapshot completed successfully.
Apr 16 21:45:05.616166 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-43708879-1714-4e74-85ec-ec22be975982 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-006a9c07-6908-4891-8667-8182437cf3c4-delete_snapshot'" released by "delete_snapshot" :: held 31.321s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:45:06.499016 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-af9e8c7f-b422-4f67-8fbd-0fad6d88957e tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-a4ae9932-693f-4cd7-b1b2-af018db63dea-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:45:06.499016 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-af9e8c7f-b422-4f67-8fbd-0fad6d88957e tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:45:28.933763 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:45:28.935311 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:45:29.010005 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:45:29.097284 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:45:37.435336 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-af9e8c7f-b422-4f67-8fbd-0fad6d88957e tempest-VolumesSnapshotTestJSON-2078807312 None] Created reservations ['5701043d-a402-4e18-882e-fe16c04cb8dc', '5632af08-83da-4f96-b2fc-0669389fb78d', '46a38928-2b70-4e32-9a9e-060c5c1416df', '8d798beb-ec37-4685-a5c9-003637936c49'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:45:37.715566 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-af9e8c7f-b422-4f67-8fbd-0fad6d88957e tempest-VolumesSnapshotTestJSON-2078807312 None] Delete snapshot completed successfully.
Apr 16 21:45:37.720814 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-af9e8c7f-b422-4f67-8fbd-0fad6d88957e tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-a4ae9932-693f-4cd7-b1b2-af018db63dea-delete_snapshot'" released by "delete_snapshot" :: held 31.228s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:45:37.837219 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8cd69da6-82c4-44ff-9e6a-039faadd0e64 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-c669e83c-f30a-4dd8-9c17-6867d2199f45-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:45:37.839076 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8cd69da6-82c4-44ff-9e6a-039faadd0e64 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:08.926963 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-8cd69da6-82c4-44ff-9e6a-039faadd0e64 tempest-VolumesSnapshotTestJSON-2078807312 None] Created reservations ['df496712-e880-4ddf-a902-67b41f455d42', '7c019546-04cf-4a37-96ec-b3b6a8c197fb', 'f22e5dac-f279-44e9-b83d-9d5796ee6846', 'eea8290c-bab9-4a8d-9efd-5f6f8f4b94bf'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:46:09.172943 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8cd69da6-82c4-44ff-9e6a-039faadd0e64 tempest-VolumesSnapshotTestJSON-2078807312 None] Delete snapshot completed successfully.
Apr 16 21:46:09.179786 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8cd69da6-82c4-44ff-9e6a-039faadd0e64 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-c669e83c-f30a-4dd8-9c17-6867d2199f45-delete_snapshot'" released by "delete_snapshot" :: held 31.343s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:46:10.856443 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-264dac83-1429-4cc6-bd35-3adc854f01cb req-298a29c9-c056-4e0c-b4d5-f8f415cf0cc6 tempest-VolumesSnapshotTestJSON-2078807312 None] Terminate volume connection completed successfully.
Apr 16 21:46:10.858534 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-264dac83-1429-4cc6-bd35-3adc854f01cb req-298a29c9-c056-4e0c-b4d5-f8f415cf0cc6 tempest-VolumesSnapshotTestJSON-2078807312 None] Deleting attachment 9c30d11b-a5ff-45b8-a541-bf1dd0aedb75. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:46:14.109338 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a4e1c1b9-86ad-4f03-b697-c15d663b7add tempest-GroupSnapshotsTest-895991370 None] Group tempest-GroupSnapshotsTest-Group-1370398580: creating
Apr 16 21:46:14.223579 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a4e1c1b9-86ad-4f03-b697-c15d663b7add tempest-GroupSnapshotsTest-895991370 None] Group tempest-GroupSnapshotsTest-Group-1370398580: created successfully
Apr 16 21:46:14.234669 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a4e1c1b9-86ad-4f03-b697-c15d663b7add tempest-GroupSnapshotsTest-895991370 None] Create group completed successfully.
Apr 16 21:46:15.945866 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:46:15.978786 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Flow 'volume_create_manager' (9e81eb58-4231-4dd8-b786-035745118008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:46:15.985654 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caea05c6-a874-4a24-8593-5647eed7e5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:16.003227 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caea05c6-a874-4a24-8593-5647eed7e5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1373360787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=86174663-74af-4e17-8064-6ff0b777166a,host='ncdv-master-1@ceph#ceph',id=af67d2d4-dd64-4914-904e-5cf3439906e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef844f40fb9f467fa5cf72079d99c54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:46:16Z,use_quota=True,user_id='aec428453a284281b783cc0497af3178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52c074a3-2148-4613-b266-158c161ddd51),volume_type_id=52c074a3-2148-4613-b266-158c161ddd51)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:16.008865 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7fcb2d-bc63-46af-9064-be9ac9dc21f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:16.013859 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7fcb2d-bc63-46af-9064-be9ac9dc21f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:16.019187 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561d3b42-00ef-4ac9-aa82-1f78d968218f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:16.023403 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561d3b42-00ef-4ac9-aa82-1f78d968218f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af67d2d4-dd64-4914-904e-5cf3439906e9', 'volume_name': 'volume-af67d2d4-dd64-4914-904e-5cf3439906e9', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:16.028581 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42a9e6e-f38a-4e46-8342-e95cd42e327b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:16.032531 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42a9e6e-f38a-4e46-8342-e95cd42e327b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:16.038429 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb7db31-44cd-4f93-b0b0-a78484b54bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:16.039614 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Volume af67d2d4-dd64-4914-904e-5cf3439906e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af67d2d4-dd64-4914-904e-5cf3439906e9', 'volume_size': 1}
Apr 16 21:46:16.040240 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] creating volume 'volume-af67d2d4-dd64-4914-904e-5cf3439906e9' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:46:16.041503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:16.206913 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d73817ba-abdf-4689-9678-c2e44d3d5198 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:16.943139 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:46:16.950326 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:46:16.952556 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb7db31-44cd-4f93-b0b0-a78484b54bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af67d2d4-dd64-4914-904e-5cf3439906e9', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:16.961437 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054dbc49-7b70-4c71-ab4e-4c65e28ba4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:17.063750 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Volume volume-af67d2d4-dd64-4914-904e-5cf3439906e9 (af67d2d4-dd64-4914-904e-5cf3439906e9): created successfully
Apr 16 21:46:17.068490 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054dbc49-7b70-4c71-ab4e-4c65e28ba4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:17.074320 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Flow 'volume_create_manager' (9e81eb58-4231-4dd8-b786-035745118008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:46:17.189438 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a7180cf4-ca27-4cf4-a0bb-7243176f6133 tempest-GroupSnapshotsTest-895991370 None] Created volume successfully.
Apr 16 21:46:18.424498 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f0bc4dc8-7cea-4da1-9529-ef31d36526fb tempest-GroupSnapshotsTest-895991370 None] GroupSnapshot 617f97f6-1d1e-4d89-963f-0fc90d8749c3: creating.
Apr 16 21:46:18.436592 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f0bc4dc8-7cea-4da1-9529-ef31d36526fb tempest-GroupSnapshotsTest-895991370 None] Group snapshot 617f97f6-1d1e-4d89-963f-0fc90d8749c3: creating. {{(pid=130674) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}}
Apr 16 21:46:18.451946 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f0bc4dc8-7cea-4da1-9529-ef31d36526fb tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:19.372595 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d73817ba-abdf-4689-9678-c2e44d3d5198 tempest-VolumesSnapshotTestJSON-2078807312 None] Create snapshot completed successfully
Apr 16 21:46:20.404688 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-effe1c62-e7ba-48a6-a95f-5af250d2d981 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-2aac8fa5-575e-430c-a0cc-197f07f324af-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:46:20.416597 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-effe1c62-e7ba-48a6-a95f-5af250d2d981 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:20.983152 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f0bc4dc8-7cea-4da1-9529-ef31d36526fb tempest-GroupSnapshotsTest-895991370 None] group_snapshot 617f97f6-1d1e-4d89-963f-0fc90d8749c3: created successfully
Apr 16 21:46:22.601291 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c3d8cc65-648e-4a87-a80f-d25dc3af6f25 tempest-GroupSnapshotsTest-895991370 None] cloning volumes/volume-af67d2d4-dd64-4914-904e-5cf3439906e9@snapshot-f63edc8e-4868-4589-94ae-87891220411f to volume-513b77b4-0609-4a7e-b4ec-f090cb920172 {{(pid=130674) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}}
Apr 16 21:46:22.602167 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c3d8cc65-648e-4a87-a80f-d25dc3af6f25 tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:22.671009 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c3d8cc65-648e-4a87-a80f-d25dc3af6f25 tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:22.886023 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-effe1c62-e7ba-48a6-a95f-5af250d2d981 tempest-VolumesSnapshotTestJSON-2078807312 None] Created reservations ['46825d5a-b0df-468f-b3e7-d86d1fa6eb55', 'f9bb9292-097a-42af-8800-c82d031840c2', 'caef27de-683d-49a2-b1b9-f563f607de47', '388c6cee-47b5-49c7-9d02-84b82cf4efce'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:46:23.078353 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-effe1c62-e7ba-48a6-a95f-5af250d2d981 tempest-VolumesSnapshotTestJSON-2078807312 None] Delete snapshot completed successfully.
Apr 16 21:46:23.087434 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-effe1c62-e7ba-48a6-a95f-5af250d2d981 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-2aac8fa5-575e-430c-a0cc-197f07f324af-delete_snapshot'" released by "delete_snapshot" :: held 2.679s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:46:23.909682 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c3d8cc65-648e-4a87-a80f-d25dc3af6f25 tempest-GroupSnapshotsTest-895991370 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:46:23.910893 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c3d8cc65-648e-4a87-a80f-d25dc3af6f25 tempest-GroupSnapshotsTest-895991370 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:46:24.087402 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24223f34-a651-424c-8029-d98982eb2fbf tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:24.324834 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c3d8cc65-648e-4a87-a80f-d25dc3af6f25 tempest-GroupSnapshotsTest-895991370 None] Create group from source-snapshot-617f97f6-1d1e-4d89-963f-0fc90d8749c3 completed successfully.
Apr 16 21:46:25.428198 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e190683c-7f0c-46b1-a481-f611feb37d24 tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:25.646472 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e190683c-7f0c-46b1-a481-f611feb37d24 tempest-GroupSnapshotsTest-895991370 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:46:25.852539 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e190683c-7f0c-46b1-a481-f611feb37d24 tempest-GroupSnapshotsTest-895991370 None] deleting rbd volume volume-513b77b4-0609-4a7e-b4ec-f090cb920172 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:46:27.006406 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-24223f34-a651-424c-8029-d98982eb2fbf tempest-VolumesSnapshotTestJSON-2078807312 None] Create snapshot completed successfully
Apr 16 21:46:28.936027 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:46:28.941833 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:29.114130 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:29.165196 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:46:30.685683 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-e190683c-7f0c-46b1-a481-f611feb37d24 tempest-GroupSnapshotsTest-895991370 None] Created reservations ['5ee7eea1-d540-4af5-a4f4-df9c23156943'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:46:30.704664 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-e190683c-7f0c-46b1-a481-f611feb37d24 tempest-GroupSnapshotsTest-895991370 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-281758807 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-281758807, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:46:30.705486 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-e190683c-7f0c-46b1-a481-f611feb37d24 tempest-GroupSnapshotsTest-895991370 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-281758807 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-281758807, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:46:30.822376 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-e190683c-7f0c-46b1-a481-f611feb37d24 tempest-GroupSnapshotsTest-895991370 None] Created reservations ['d4a69851-f5bc-40dd-b4c2-16a84df18b06', '007764e7-d763-479c-8ea5-09f316234e1a', '8227bbd5-401e-4fb6-94d4-289ef32b360d', '2e65e3df-12f5-4c78-9cb7-179c2d855154'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:46:31.155858 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e190683c-7f0c-46b1-a481-f611feb37d24 tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:31.209915 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e190683c-7f0c-46b1-a481-f611feb37d24 tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:31.268930 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-e190683c-7f0c-46b1-a481-f611feb37d24 tempest-GroupSnapshotsTest-895991370 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:46:31.277802 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e190683c-7f0c-46b1-a481-f611feb37d24 tempest-GroupSnapshotsTest-895991370 None] Delete group completed successfully.
Apr 16 21:46:32.194517 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1d0615ba-087c-4f2b-a5c4-9ced716ac84e tempest-GroupSnapshotsTest-895991370 None] group_snapshot 617f97f6-1d1e-4d89-963f-0fc90d8749c3: deleting
Apr 16 21:46:32.214683 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1d0615ba-087c-4f2b-a5c4-9ced716ac84e tempest-GroupSnapshotsTest-895991370 None] group_snapshot 617f97f6-1d1e-4d89-963f-0fc90d8749c3: deleting {{(pid=130674) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}}
Apr 16 21:46:32.238034 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1d0615ba-087c-4f2b-a5c4-9ced716ac84e tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:35.183707 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-1d0615ba-087c-4f2b-a5c4-9ced716ac84e tempest-GroupSnapshotsTest-895991370 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-281758807 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-281758807, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:46:35.285275 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-1d0615ba-087c-4f2b-a5c4-9ced716ac84e tempest-GroupSnapshotsTest-895991370 None] Created reservations ['191fff03-8e25-4adf-97c2-631bb543fb9c', '7f1f666f-c568-4636-b010-84f620ceac28', 'fef332f1-b637-4225-be84-2ce6c85816e7', '6cb5fae0-4585-45cf-baaa-790dea04449b'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:46:35.612103 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1d0615ba-087c-4f2b-a5c4-9ced716ac84e tempest-GroupSnapshotsTest-895991370 None] group_snapshot 617f97f6-1d1e-4d89-963f-0fc90d8749c3: deleted successfully
Apr 16 21:46:36.316166 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:46:36.336998 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Flow 'volume_create_manager' (fc9be45c-87a4-4331-8843-af67db7aac64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:46:36.345050 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda89095-f876-42fb-a1c6-7165987aa941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:36.362551 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda89095-f876-42fb-a1c6-7165987aa941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1508463944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=273ee8d5-e6da-4069-ad60-d30f79fa2679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfcde168250f4d16b2d305afed23fee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:46:36Z,use_quota=True,user_id='9771814136c84ab3a13bc98dfd79a40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:36.368724 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caff2944-e891-47b1-aa89-c3a93e75a1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:36.373650 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caff2944-e891-47b1-aa89-c3a93e75a1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:36.379380 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5be0b0-ac80-493b-97d6-56e19efd3756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:36.504912 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5be0b0-ac80-493b-97d6-56e19efd3756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '273ee8d5-e6da-4069-ad60-d30f79fa2679', 'volume_name': 'volume-273ee8d5-e6da-4069-ad60-d30f79fa2679', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710b54910>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:36.516101 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f43d81e3-1cd0-4e8d-a4bc-6bff4578b80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:36.524520 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f43d81e3-1cd0-4e8d-a4bc-6bff4578b80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:36.530868 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c527ba98-4fbe-42d6-8554-05bc2bd412a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:36.534858 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Volume 273ee8d5-e6da-4069-ad60-d30f79fa2679: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-273ee8d5-e6da-4069-ad60-d30f79fa2679', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710b54910>}
Apr 16 21:46:36.535655 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Cloning 273ee8d5-e6da-4069-ad60-d30f79fa2679 from image 88bbe9a7-19d2-4102-9634-058b7c590848  at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 16 21:46:36.548882 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:46:36.646517 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 46, 36, 554721)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:46:36.647318 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:46:36.647921 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Found cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 16 21:46:36.656090 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" released by "_prepare_image_cache_entry" :: held 0.106s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:46:36.658830 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Attempting to retrieve cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 16 21:46:36.686711 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 46, 36, 678374)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:46:36.687284 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:46:36.688287 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Creating from source image-volume e0e222dd-75a5-4728-81e0-d352ad2a6247 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 16 21:46:36.704603 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:36.931728 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] creating snapshot='volume-273ee8d5-e6da-4069-ad60-d30f79fa2679.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:46:38.526174 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] cloning 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247@volume-273ee8d5-e6da-4069-ad60-d30f79fa2679.clone_snap' to 'volume-273ee8d5-e6da-4069-ad60-d30f79fa2679' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:46:38.557860 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b08f976a-a373-4d8e-830c-a337c575576a tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:38.760436 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b08f976a-a373-4d8e-830c-a337c575576a tempest-GroupSnapshotsTest-895991370 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:46:38.760874 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b08f976a-a373-4d8e-830c-a337c575576a tempest-GroupSnapshotsTest-895991370 None] Volume volume-af67d2d4-dd64-4914-904e-5cf3439906e9 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:46:38.983278 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b08f976a-a373-4d8e-830c-a337c575576a tempest-GroupSnapshotsTest-895991370 None] deleting rbd volume volume-af67d2d4-dd64-4914-904e-5cf3439906e9 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:46:40.070922 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:46:40.072098 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:46:40.072573 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:46:40.680096 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:46:40.680763 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Marking volume 273ee8d5-e6da-4069-ad60-d30f79fa2679 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:46:40.770270 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Copying metadata from image 88bbe9a7-19d2-4102-9634-058b7c590848 to 273ee8d5-e6da-4069-ad60-d30f79fa2679. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 16 21:46:40.770709 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Creating volume glance metadata for volume 273ee8d5-e6da-4069-ad60-d30f79fa2679 backed by image 88bbe9a7-19d2-4102-9634-058b7c590848 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 16 21:46:40.872689 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c527ba98-4fbe-42d6-8554-05bc2bd412a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-273ee8d5-e6da-4069-ad60-d30f79fa2679', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710b54910>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:40.877413 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d66205-f408-42a8-858a-9c54160d762e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:40.960263 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Volume volume-273ee8d5-e6da-4069-ad60-d30f79fa2679 (273ee8d5-e6da-4069-ad60-d30f79fa2679): created successfully
Apr 16 21:46:40.963971 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d66205-f408-42a8-858a-9c54160d762e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:40.970881 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Flow 'volume_create_manager' (fc9be45c-87a4-4331-8843-af67db7aac64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:46:41.057062 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-98122c5c-d2bd-4f37-853a-b325add3037a tempest-TestVolumeBootPattern-410552364 None] Created volume successfully.
Apr 16 21:46:42.028039 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d46e3327-505b-4c4a-8316-31c3ccc34959 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:42.489935 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-c78dbece-c607-4a7f-8b62-2c95fc1cf1fc req-c7470233-5d34-448c-8ad9-abe4bf6c0eb7 tempest-VolumesSnapshotTestJSON-2078807312 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:46:43.111448 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-c78dbece-c607-4a7f-8b62-2c95fc1cf1fc req-c7470233-5d34-448c-8ad9-abe4bf6c0eb7 tempest-VolumesSnapshotTestJSON-2078807312 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.621s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:46:43.112271 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-c78dbece-c607-4a7f-8b62-2c95fc1cf1fc req-c7470233-5d34-448c-8ad9-abe4bf6c0eb7 tempest-VolumesSnapshotTestJSON-2078807312 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b419c8ec-d8d6-495e-9cec-3da461c92db9', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'b419c8ec-d8d6-495e-9cec-3da461c92db9', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:46:43.171318 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-c78dbece-c607-4a7f-8b62-2c95fc1cf1fc req-c7470233-5d34-448c-8ad9-abe4bf6c0eb7 tempest-VolumesSnapshotTestJSON-2078807312 None] Connection info returned from driver {'name': 'volumes/volume-b419c8ec-d8d6-495e-9cec-3da461c92db9', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b419c8ec-d8d6-495e-9cec-3da461c92db9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b6f12e3c-8924-4cf6-86b6-af2504018ad5'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:46:43.271242 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-c78dbece-c607-4a7f-8b62-2c95fc1cf1fc req-c7470233-5d34-448c-8ad9-abe4bf6c0eb7 tempest-VolumesSnapshotTestJSON-2078807312 None] attachment_update completed successfully.
Apr 16 21:46:43.519832 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-b08f976a-a373-4d8e-830c-a337c575576a tempest-GroupSnapshotsTest-895991370 None] Created reservations ['29b2f442-d296-4480-81f5-fa206b9ed814'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:46:43.548140 ncdv-master-1 cinder-volume[130674]: WARNING cinder.db.sqlalchemy.api [None req-b08f976a-a373-4d8e-830c-a337c575576a tempest-GroupSnapshotsTest-895991370 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-281758807']
Apr 16 21:46:43.619406 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-b08f976a-a373-4d8e-830c-a337c575576a tempest-GroupSnapshotsTest-895991370 None] Created reservations ['daa0c7ab-bda8-4e17-a40c-7afb7a3a92e3', '6013fce1-33db-473f-a99a-c77a48b98e12', '3333b745-a0e2-4f3c-8101-b0925b444b68', '84e1deed-7c40-4380-8341-2e5a72b6d190'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:46:43.950965 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b08f976a-a373-4d8e-830c-a337c575576a tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:43.973439 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b08f976a-a373-4d8e-830c-a337c575576a tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:43.994878 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-b08f976a-a373-4d8e-830c-a337c575576a tempest-GroupSnapshotsTest-895991370 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:46:43.999718 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b08f976a-a373-4d8e-830c-a337c575576a tempest-GroupSnapshotsTest-895991370 None] Delete group completed successfully.
Apr 16 21:46:44.685808 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d46e3327-505b-4c4a-8316-31c3ccc34959 tempest-TestVolumeBootPattern-410552364 None] Create snapshot completed successfully
Apr 16 21:46:45.482717 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d17ea183-4720-40da-b8d7-73ae22f9912b tempest-GroupSnapshotsTest-895991370 None] Group tempest-GroupSnapshotsTest-Group-408630922: creating
Apr 16 21:46:45.606193 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d17ea183-4720-40da-b8d7-73ae22f9912b tempest-GroupSnapshotsTest-895991370 None] Group tempest-GroupSnapshotsTest-Group-408630922: created successfully
Apr 16 21:46:45.617340 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d17ea183-4720-40da-b8d7-73ae22f9912b tempest-GroupSnapshotsTest-895991370 None] Create group completed successfully.
Apr 16 21:46:47.054723 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4f9c2169-05e3-4e8f-9f7f-0afb4211e54e tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:47.275645 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:46:47.296071 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Flow 'volume_create_manager' (b1223d8f-dec0-4a2c-83b0-113e16ecc56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:46:47.303215 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695710b9-2c42-410f-b568-26678a1f73db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:47.319692 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695710b9-2c42-410f-b568-26678a1f73db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-720583591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed4654e4-ac8c-4941-9e96-9dbfe9c5cdd0,host='ncdv-master-1@ceph#ceph',id=123edc77-7d5f-4041-96b9-253a0d2ae0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef844f40fb9f467fa5cf72079d99c54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:46:47Z,use_quota=True,user_id='aec428453a284281b783cc0497af3178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8110435c-2623-43fe-8a11-31bee6076936),volume_type_id=8110435c-2623-43fe-8a11-31bee6076936)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:47.325717 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c22eeb-c2cb-4d44-8269-8a40c52cd8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:47.329894 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c22eeb-c2cb-4d44-8269-8a40c52cd8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:47.335027 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff294779-b56d-41ad-a11b-fd6a595ee177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:47.339097 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff294779-b56d-41ad-a11b-fd6a595ee177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '123edc77-7d5f-4041-96b9-253a0d2ae0c0', 'volume_name': 'volume-123edc77-7d5f-4041-96b9-253a0d2ae0c0', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:47.344670 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fc66d5-85f6-4e6c-9048-eebed3694a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:47.348585 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fc66d5-85f6-4e6c-9048-eebed3694a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:47.353325 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6616e9c0-8583-4d58-a111-00e605557b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:47.354450 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Volume 123edc77-7d5f-4041-96b9-253a0d2ae0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-123edc77-7d5f-4041-96b9-253a0d2ae0c0', 'volume_size': 1}
Apr 16 21:46:47.354845 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] creating volume 'volume-123edc77-7d5f-4041-96b9-253a0d2ae0c0' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:46:47.355622 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:47.811144 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:46:47.811794 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:46:47.817135 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6616e9c0-8583-4d58-a111-00e605557b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-123edc77-7d5f-4041-96b9-253a0d2ae0c0', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:47.823009 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b3d4a7-f894-4706-afa6-c3e442931179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:47.925630 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Volume volume-123edc77-7d5f-4041-96b9-253a0d2ae0c0 (123edc77-7d5f-4041-96b9-253a0d2ae0c0): created successfully
Apr 16 21:46:47.929479 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b3d4a7-f894-4706-afa6-c3e442931179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:47.936049 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Flow 'volume_create_manager' (b1223d8f-dec0-4a2c-83b0-113e16ecc56b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:46:48.017938 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-590aa9b4-72b7-493c-a444-8c4169b95431 tempest-GroupSnapshotsTest-895991370 None] Created volume successfully.
Apr 16 21:46:48.910965 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:46:48.931093 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Flow 'volume_create_manager' (b6ee3207-380d-4e8c-aa3a-958a79a5f0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:46:48.938037 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1a529f-20b4-4bb6-be29-c05eecee8a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:48.944828 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:46:48.965957 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1a529f-20b4-4bb6-be29-c05eecee8a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-2026757912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed4654e4-ac8c-4941-9e96-9dbfe9c5cdd0,host='ncdv-master-1@ceph#ceph',id=d5406360-28b9-4ece-b643-5374529dc66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef844f40fb9f467fa5cf72079d99c54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:46:49Z,use_quota=True,user_id='aec428453a284281b783cc0497af3178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8110435c-2623-43fe-8a11-31bee6076936),volume_type_id=8110435c-2623-43fe-8a11-31bee6076936)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:48.971610 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af665b5f-4e61-4f4e-b6c9-75c600c91dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:48.975877 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af665b5f-4e61-4f4e-b6c9-75c600c91dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:48.981230 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796a125b-a13b-4084-ad8b-42bbbcb719da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:48.985425 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796a125b-a13b-4084-ad8b-42bbbcb719da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5406360-28b9-4ece-b643-5374529dc66e', 'volume_name': 'volume-d5406360-28b9-4ece-b643-5374529dc66e', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:48.990736 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff65a2fd-abc8-444e-a914-98adbbb4fa62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:48.994749 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff65a2fd-abc8-444e-a914-98adbbb4fa62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:49.000122 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eeee54a-cb63-4c7f-942f-5c08b64c99ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:49.001323 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Volume d5406360-28b9-4ece-b643-5374529dc66e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5406360-28b9-4ece-b643-5374529dc66e', 'volume_size': 1}
Apr 16 21:46:49.001735 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] creating volume 'volume-d5406360-28b9-4ece-b643-5374529dc66e' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:46:49.002414 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:49.030833 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4f9c2169-05e3-4e8f-9f7f-0afb4211e54e tempest-VolumesSnapshotTestJSON-2078807312 None] Create snapshot completed successfully
Apr 16 21:46:49.050656 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Flow 'volume_create_manager' (16f8219a-7d52-4ac2-99e2-289c9a95ce41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:46:49.057283 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f65c203-ae27-4a72-a851-ad4ac25fecee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:49.075023 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f65c203-ae27-4a72-a851-ad4ac25fecee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:46:48Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=83440ed4-7662-4c9c-9b6c-f20528e90f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfcde168250f4d16b2d305afed23fee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dbaffdb9-592f-43f8-8f98-1f062f804f7e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:46:49Z,use_quota=True,user_id='9771814136c84ab3a13bc98dfd79a40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:49.080557 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f5a40e-fb00-4860-90a8-9e80ee251c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:49.084804 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f5a40e-fb00-4860-90a8-9e80ee251c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:49.090065 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6054d6e5-8c37-439c-a757-b26b829c111f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:49.094210 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6054d6e5-8c37-439c-a757-b26b829c111f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '83440ed4-7662-4c9c-9b6c-f20528e90f38', 'volume_name': 'volume-83440ed4-7662-4c9c-9b6c-f20528e90f38', 'volume_size': 1, 'snapshot_id': 'dbaffdb9-592f-43f8-8f98-1f062f804f7e'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:49.099314 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4233801-0648-4657-908e-d14c039aa1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:49.106491 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4233801-0648-4657-908e-d14c039aa1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:49.108235 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04d72a0-8adb-4f05-8724-9f707a593a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:49.109426 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Volume 83440ed4-7662-4c9c-9b6c-f20528e90f38: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-83440ed4-7662-4c9c-9b6c-f20528e90f38', 'volume_size': 1, 'snapshot_id': 'dbaffdb9-592f-43f8-8f98-1f062f804f7e'}
Apr 16 21:46:49.131195 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] cloning volumes/volume-273ee8d5-e6da-4069-ad60-d30f79fa2679@snapshot-dbaffdb9-592f-43f8-8f98-1f062f804f7e to volume-83440ed4-7662-4c9c-9b6c-f20528e90f38 {{(pid=130674) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}}
Apr 16 21:46:49.131868 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:49.298428 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:49.510600 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:46:49.511114 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:46:49.516635 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eeee54a-cb63-4c7f-942f-5c08b64c99ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5406360-28b9-4ece-b643-5374529dc66e', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:49.521733 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e776e01-3d7f-42ef-ae08-57d4d92e392b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:49.612226 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Volume volume-d5406360-28b9-4ece-b643-5374529dc66e (d5406360-28b9-4ece-b643-5374529dc66e): created successfully
Apr 16 21:46:49.616548 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e776e01-3d7f-42ef-ae08-57d4d92e392b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:49.622990 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Flow 'volume_create_manager' (b6ee3207-380d-4e8c-aa3a-958a79a5f0c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:46:49.715202 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f8fc53f9-5e53-4dd8-bd84-99cafcc2cfcc tempest-GroupSnapshotsTest-895991370 None] Created volume successfully.
Apr 16 21:46:50.044595 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5d9c3e42-71b5-4453-ab5c-bdf74f2b81f2 tempest-GroupSnapshotsTest-895991370 None] Update group completed successfully.
Apr 16 21:46:50.502404 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:46:50.502818 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:46:50.518414 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Marking volume 83440ed4-7662-4c9c-9b6c-f20528e90f38 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:46:50.549849 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d4a7edf5-a188-47fa-b0ed-0fe74538be36 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:50.748356 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Copying metadata from snapshot dbaffdb9-592f-43f8-8f98-1f062f804f7e to 83440ed4-7662-4c9c-9b6c-f20528e90f38. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}}
Apr 16 21:46:50.866013 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04d72a0-8adb-4f05-8724-9f707a593a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83440ed4-7662-4c9c-9b6c-f20528e90f38', 'volume_size': 1, 'snapshot_id': 'dbaffdb9-592f-43f8-8f98-1f062f804f7e'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:50.870826 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb962a8f-9ccb-4801-8075-46a587c9d42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:46:50.950362 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Volume volume-83440ed4-7662-4c9c-9b6c-f20528e90f38 (83440ed4-7662-4c9c-9b6c-f20528e90f38): created successfully
Apr 16 21:46:50.952693 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb962a8f-9ccb-4801-8075-46a587c9d42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:46:50.958490 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Flow 'volume_create_manager' (16f8219a-7d52-4ac2-99e2-289c9a95ce41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:46:51.015349 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-3cf63a16-2095-4f68-9038-dd4c4b355690 tempest-TestVolumeBootPattern-410552364 None] Created volume successfully.
Apr 16 21:46:51.262682 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9eb3c034-a6b9-45c3-95e4-f43d455f3e85 tempest-GroupSnapshotsTest-895991370 None] Update group completed successfully.
Apr 16 21:46:52.138287 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-85d43aa0-84c3-4554-b883-76c20bdf28d9 tempest-TestVolumeBootPattern-410552364 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:46:52.438077 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-da8f818e-3ee7-4305-8760-2429261436c4 tempest-GroupSnapshotsTest-895991370 None] Update group completed successfully.
Apr 16 21:46:52.790681 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-85d43aa0-84c3-4554-b883-76c20bdf28d9 tempest-TestVolumeBootPattern-410552364 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.652s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:46:52.791228 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-85d43aa0-84c3-4554-b883-76c20bdf28d9 tempest-TestVolumeBootPattern-410552364 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-83440ed4-7662-4c9c-9b6c-f20528e90f38', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '83440ed4-7662-4c9c-9b6c-f20528e90f38', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:46:52.845330 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d4a7edf5-a188-47fa-b0ed-0fe74538be36 tempest-VolumesSnapshotTestJSON-2078807312 None] Create snapshot completed successfully
Apr 16 21:46:52.862352 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-85d43aa0-84c3-4554-b883-76c20bdf28d9 tempest-TestVolumeBootPattern-410552364 None] Connection info returned from driver {'name': 'volumes/volume-83440ed4-7662-4c9c-9b6c-f20528e90f38', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '83440ed4-7662-4c9c-9b6c-f20528e90f38', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a03b04a3-dbb8-4b76-96c1-f70c61edc97f'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:46:52.941252 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 req-85d43aa0-84c3-4554-b883-76c20bdf28d9 tempest-TestVolumeBootPattern-410552364 None] attachment_update completed successfully.
Apr 16 21:46:53.707067 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c91bbdbe-2e9e-4c09-b3df-5518883e7e50 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-fb77b690-2ac3-4983-ae13-ce7e96237ff2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:46:53.710204 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c91bbdbe-2e9e-4c09-b3df-5518883e7e50 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:53.846755 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1782b8b3-8c45-4d48-a050-668f30373542 tempest-GroupSnapshotsTest-895991370 None] Update group completed successfully.
Apr 16 21:46:55.180438 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f05fffac-cfe6-49c9-bb7e-812391ec9a55 tempest-GroupSnapshotsTest-895991370 None] GroupSnapshot f1146bbb-922d-4e83-836f-8fd263ef997e: creating.
Apr 16 21:46:55.197508 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f05fffac-cfe6-49c9-bb7e-812391ec9a55 tempest-GroupSnapshotsTest-895991370 None] Group snapshot f1146bbb-922d-4e83-836f-8fd263ef997e: creating. {{(pid=130674) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}}
Apr 16 21:46:55.212771 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f05fffac-cfe6-49c9-bb7e-812391ec9a55 tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:57.848263 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f05fffac-cfe6-49c9-bb7e-812391ec9a55 tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:46:59.691434 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f05fffac-cfe6-49c9-bb7e-812391ec9a55 tempest-GroupSnapshotsTest-895991370 None] group_snapshot f1146bbb-922d-4e83-836f-8fd263ef997e: created successfully
Apr 16 21:47:00.737836 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ae320eba-e639-41fe-9b88-fe50e43df5ff tempest-GroupSnapshotsTest-895991370 None] group_snapshot f1146bbb-922d-4e83-836f-8fd263ef997e: deleting
Apr 16 21:47:00.758401 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ae320eba-e639-41fe-9b88-fe50e43df5ff tempest-GroupSnapshotsTest-895991370 None] group_snapshot f1146bbb-922d-4e83-836f-8fd263ef997e: deleting {{(pid=130674) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}}
Apr 16 21:47:00.773889 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ae320eba-e639-41fe-9b88-fe50e43df5ff tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:02.585583 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ae320eba-e639-41fe-9b88-fe50e43df5ff tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:05.570389 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-ae320eba-e639-41fe-9b88-fe50e43df5ff tempest-GroupSnapshotsTest-895991370 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-953983224 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-953983224, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:47:05.578167 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-ae320eba-e639-41fe-9b88-fe50e43df5ff tempest-GroupSnapshotsTest-895991370 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-953983224 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-953983224, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:47:05.638173 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-ae320eba-e639-41fe-9b88-fe50e43df5ff tempest-GroupSnapshotsTest-895991370 None] Created reservations ['74a1fe31-05c7-4379-b9ff-0c14c45691ae', '7df4cfdf-b7df-404c-9dc5-b5df0e9dcfb1', '256eff0b-ae1a-41dd-92ab-a363f64a4f01', '0f01ad03-9dab-4683-844f-eb649cd0ff33'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:47:05.889807 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-ae320eba-e639-41fe-9b88-fe50e43df5ff tempest-GroupSnapshotsTest-895991370 None] Created reservations ['503aa1a5-638e-492c-8675-6962c3a62c83', 'ab7e1b49-e064-45c6-9a19-bd11cc67aa25', '409c82c6-dcbc-44ab-96eb-9a523b3ba01d', '6c95a79f-3212-4022-97f6-e12fb577b0ac'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:47:06.148392 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ae320eba-e639-41fe-9b88-fe50e43df5ff tempest-GroupSnapshotsTest-895991370 None] group_snapshot f1146bbb-922d-4e83-836f-8fd263ef997e: deleted successfully
Apr 16 21:47:06.213413 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-9345d937-5183-462e-a9de-b404529f88f9 req-3a150d1b-b8ba-43a9-af1e-7ec00dd0a3cb tempest-TestVolumeBootPattern-410552364 None] Terminate volume connection completed successfully.
Apr 16 21:47:06.214951 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9345d937-5183-462e-a9de-b404529f88f9 req-3a150d1b-b8ba-43a9-af1e-7ec00dd0a3cb tempest-TestVolumeBootPattern-410552364 None] Deleting attachment a03b04a3-dbb8-4b76-96c1-f70c61edc97f. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:47:06.561950 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-9345d937-5183-462e-a9de-b404529f88f9 req-ce163017-42e6-42e0-9f94-f148719f9990 tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-83440ed4-7662-4c9c-9b6c-f20528e90f38-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:47:06.627176 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-21a21e85-00df-44a0-a25d-008174a294cd tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:06.809327 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-21a21e85-00df-44a0-a25d-008174a294cd tempest-GroupSnapshotsTest-895991370 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:47:06.809704 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-21a21e85-00df-44a0-a25d-008174a294cd tempest-GroupSnapshotsTest-895991370 None] Volume volume-123edc77-7d5f-4041-96b9-253a0d2ae0c0 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:47:06.948092 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-21a21e85-00df-44a0-a25d-008174a294cd tempest-GroupSnapshotsTest-895991370 None] deleting rbd volume volume-123edc77-7d5f-4041-96b9-253a0d2ae0c0 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:47:06.969145 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-9345d937-5183-462e-a9de-b404529f88f9 req-ce163017-42e6-42e0-9f94-f148719f9990 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:07.164872 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-9345d937-5183-462e-a9de-b404529f88f9 req-ce163017-42e6-42e0-9f94-f148719f9990 tempest-TestVolumeBootPattern-410552364 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:47:07.372635 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-9345d937-5183-462e-a9de-b404529f88f9 req-ce163017-42e6-42e0-9f94-f148719f9990 tempest-TestVolumeBootPattern-410552364 None] deleting rbd volume volume-83440ed4-7662-4c9c-9b6c-f20528e90f38 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:47:12.804668 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-21a21e85-00df-44a0-a25d-008174a294cd tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:12.981422 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-21a21e85-00df-44a0-a25d-008174a294cd tempest-GroupSnapshotsTest-895991370 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:47:12.981774 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-21a21e85-00df-44a0-a25d-008174a294cd tempest-GroupSnapshotsTest-895991370 None] Volume volume-d5406360-28b9-4ece-b643-5374529dc66e is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:47:13.199163 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-21a21e85-00df-44a0-a25d-008174a294cd tempest-GroupSnapshotsTest-895991370 None] deleting rbd volume volume-d5406360-28b9-4ece-b643-5374529dc66e {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:47:13.359363 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-9345d937-5183-462e-a9de-b404529f88f9 req-ce163017-42e6-42e0-9f94-f148719f9990 tempest-TestVolumeBootPattern-410552364 None] Created reservations ['97ff0de0-d613-47d8-a187-cb8d06b66e2e', 'b1ace1a8-2e34-4b81-a5d3-815bd3a034f2', '039febcd-0f8f-4b31-b24a-993505081ad1', '6f74ad94-cd6b-4815-a263-83f76469a6a7'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:47:13.530612 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-9345d937-5183-462e-a9de-b404529f88f9 req-ce163017-42e6-42e0-9f94-f148719f9990 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:13.554617 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-9345d937-5183-462e-a9de-b404529f88f9 req-ce163017-42e6-42e0-9f94-f148719f9990 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:13.577344 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-9345d937-5183-462e-a9de-b404529f88f9 req-ce163017-42e6-42e0-9f94-f148719f9990 tempest-TestVolumeBootPattern-410552364 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:47:13.581628 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-9345d937-5183-462e-a9de-b404529f88f9 req-ce163017-42e6-42e0-9f94-f148719f9990 tempest-TestVolumeBootPattern-410552364 None] Deleted volume successfully.
Apr 16 21:47:13.637303 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-9345d937-5183-462e-a9de-b404529f88f9 req-ce163017-42e6-42e0-9f94-f148719f9990 tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-83440ed4-7662-4c9c-9b6c-f20528e90f38-delete_volume'" released by "delete_volume" :: held 7.075s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:47:13.883559 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ab1c1e63-d77f-47b9-9529-d8f543570f54 tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-dbaffdb9-592f-43f8-8f98-1f062f804f7e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:47:13.885151 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ab1c1e63-d77f-47b9-9529-d8f543570f54 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:17.593584 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-ab1c1e63-d77f-47b9-9529-d8f543570f54 tempest-TestVolumeBootPattern-410552364 None] Created reservations ['29c5a469-4854-4289-ab9b-d984d55a4573', 'a0a5541f-417b-4bbd-b333-ecedcbd64135', '2d2ef799-34f1-4ecd-b649-f200b3f43170', '40d5933f-af44-46c1-8650-c678f2c7df5c'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:47:17.889236 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ab1c1e63-d77f-47b9-9529-d8f543570f54 tempest-TestVolumeBootPattern-410552364 None] Delete snapshot completed successfully.
Apr 16 21:47:17.894448 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ab1c1e63-d77f-47b9-9529-d8f543570f54 tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-dbaffdb9-592f-43f8-8f98-1f062f804f7e-delete_snapshot'" released by "delete_snapshot" :: held 4.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:47:18.141739 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-21a21e85-00df-44a0-a25d-008174a294cd tempest-GroupSnapshotsTest-895991370 None] Created reservations ['81dd19a8-9e0e-456c-b920-c8efdedd52d0'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:47:18.158431 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-21a21e85-00df-44a0-a25d-008174a294cd tempest-GroupSnapshotsTest-895991370 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-953983224 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-953983224, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:47:18.183410 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9b12713a-769b-4c01-a18c-a26bd51d316f tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-273ee8d5-e6da-4069-ad60-d30f79fa2679-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:47:18.244632 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-21a21e85-00df-44a0-a25d-008174a294cd tempest-GroupSnapshotsTest-895991370 None] Created reservations ['350312fd-54cc-4508-a85e-c1fba2b45725', 'f2383a87-c86e-4563-8ec0-53ae7505ecea', '15527f40-a637-4155-aef7-f244079e6002', 'e7693284-7bf1-46d6-9b89-259878f97925'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:47:18.277547 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9b12713a-769b-4c01-a18c-a26bd51d316f tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:18.438279 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9b12713a-769b-4c01-a18c-a26bd51d316f tempest-TestVolumeBootPattern-410552364 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:47:18.542559 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9b12713a-769b-4c01-a18c-a26bd51d316f tempest-TestVolumeBootPattern-410552364 None] deleting rbd volume volume-273ee8d5-e6da-4069-ad60-d30f79fa2679 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:47:18.741736 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-21a21e85-00df-44a0-a25d-008174a294cd tempest-GroupSnapshotsTest-895991370 None] Created reservations ['c0f3473c-6c27-494a-a966-ea5c4a34befb', 'f024e190-a6ba-47be-bf24-06c20912d4a9', 'ad5f89af-e420-4b49-907c-e91e6b2d2207', '7db0757a-c12b-46a9-a57b-415560d32412'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:47:19.098537 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-21a21e85-00df-44a0-a25d-008174a294cd tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:19.119000 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-21a21e85-00df-44a0-a25d-008174a294cd tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:19.141939 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-21a21e85-00df-44a0-a25d-008174a294cd tempest-GroupSnapshotsTest-895991370 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:47:19.146776 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-21a21e85-00df-44a0-a25d-008174a294cd tempest-GroupSnapshotsTest-895991370 None] Delete group completed successfully.
Apr 16 21:47:20.195274 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-41ad1707-7b2b-43bd-b792-1910ce1f1050 tempest-GroupSnapshotsTest-895991370 None] Group tempest-GroupSnapshotsTest-Group-1906748528: creating
Apr 16 21:47:20.271717 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-41ad1707-7b2b-43bd-b792-1910ce1f1050 tempest-GroupSnapshotsTest-895991370 None] Group tempest-GroupSnapshotsTest-Group-1906748528: created successfully
Apr 16 21:47:20.280423 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-41ad1707-7b2b-43bd-b792-1910ce1f1050 tempest-GroupSnapshotsTest-895991370 None] Create group completed successfully.
Apr 16 21:47:21.765253 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9b12713a-769b-4c01-a18c-a26bd51d316f tempest-TestVolumeBootPattern-410552364 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:47:21.931185 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9b12713a-769b-4c01-a18c-a26bd51d316f tempest-TestVolumeBootPattern-410552364 None] deleting parent snapshot volume-273ee8d5-e6da-4069-ad60-d30f79fa2679.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:47:23.571803 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:47:23.614695 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Flow 'volume_create_manager' (bc4ca22c-f1d4-42fb-952b-370cb29cd3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:47:23.621545 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65cfa6f-4b3e-468f-b290-718b7021e47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:23.626761 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-9b12713a-769b-4c01-a18c-a26bd51d316f tempest-TestVolumeBootPattern-410552364 None] Created reservations ['6235e8aa-e417-49e4-9551-d498ed0c08bb', '4f8208cb-000d-4cdc-84db-dca90cdc5bae', '2a3b948e-838a-4481-acdd-ff28cbfd817e', 'b5daa477-73ce-45cb-9749-1bd4961e431d'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:47:23.640428 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65cfa6f-4b3e-468f-b290-718b7021e47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1316148212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fb5ce4bf-c26e-462d-a7d7-5295d929ca5b,host='ncdv-master-1@ceph#ceph',id=ac955ea0-3e7d-46f1-9af5-b0dbc9f2af3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef844f40fb9f467fa5cf72079d99c54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:47:22Z,use_quota=True,user_id='aec428453a284281b783cc0497af3178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2618639b-3ffd-4b83-acc9-10a6fdf63c34),volume_type_id=2618639b-3ffd-4b83-acc9-10a6fdf63c34)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:23.646559 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb476bef-3431-44dc-9a83-47ec2b1585e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:23.650746 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb476bef-3431-44dc-9a83-47ec2b1585e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:23.655944 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d174c7-2e03-4ac4-a1ce-8a6dcea497f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:23.660303 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d174c7-2e03-4ac4-a1ce-8a6dcea497f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac955ea0-3e7d-46f1-9af5-b0dbc9f2af3a', 'volume_name': 'volume-ac955ea0-3e7d-46f1-9af5-b0dbc9f2af3a', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:23.665407 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee626cd3-32dc-43cb-b9bb-d5687fdea21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:23.669490 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee626cd3-32dc-43cb-b9bb-d5687fdea21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:23.674374 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d2b120-2e17-4685-a8d1-258fe972b7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:23.675527 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Volume ac955ea0-3e7d-46f1-9af5-b0dbc9f2af3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac955ea0-3e7d-46f1-9af5-b0dbc9f2af3a', 'volume_size': 1}
Apr 16 21:47:23.675932 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] creating volume 'volume-ac955ea0-3e7d-46f1-9af5-b0dbc9f2af3a' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:47:23.676990 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:23.890344 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9b12713a-769b-4c01-a18c-a26bd51d316f tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:23.910967 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9b12713a-769b-4c01-a18c-a26bd51d316f tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:23.932833 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-9b12713a-769b-4c01-a18c-a26bd51d316f tempest-TestVolumeBootPattern-410552364 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:47:23.936654 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9b12713a-769b-4c01-a18c-a26bd51d316f tempest-TestVolumeBootPattern-410552364 None] Deleted volume successfully.
Apr 16 21:47:24.008751 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9b12713a-769b-4c01-a18c-a26bd51d316f tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-273ee8d5-e6da-4069-ad60-d30f79fa2679-delete_volume'" released by "delete_volume" :: held 5.825s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:47:24.456128 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-c91bbdbe-2e9e-4c09-b3df-5518883e7e50 tempest-VolumesSnapshotTestJSON-2078807312 None] Created reservations ['6fb6d903-929c-4feb-b61b-84e2a9411a3f', 'f5df74ac-1f46-40d2-9fac-5a052f5290ac', '5c7062b6-5da4-4352-b4d7-d88d49ef54c9', '9eab84e1-5e4d-47c2-8f8b-48c39a314ada'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:47:24.461850 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:47:24.462255 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:47:24.466014 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d2b120-2e17-4685-a8d1-258fe972b7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac955ea0-3e7d-46f1-9af5-b0dbc9f2af3a', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:24.471444 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4055471-e70c-45fa-a3f9-2f13f1d3c5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:24.524703 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Volume volume-ac955ea0-3e7d-46f1-9af5-b0dbc9f2af3a (ac955ea0-3e7d-46f1-9af5-b0dbc9f2af3a): created successfully
Apr 16 21:47:24.528511 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4055471-e70c-45fa-a3f9-2f13f1d3c5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:24.534945 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Flow 'volume_create_manager' (bc4ca22c-f1d4-42fb-952b-370cb29cd3d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:47:24.591698 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0277a5d6-df79-4f99-84c3-72cff8157f17 tempest-GroupSnapshotsTest-895991370 None] Created volume successfully.
Apr 16 21:47:24.621376 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c91bbdbe-2e9e-4c09-b3df-5518883e7e50 tempest-VolumesSnapshotTestJSON-2078807312 None] Delete snapshot completed successfully.
Apr 16 21:47:24.626726 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c91bbdbe-2e9e-4c09-b3df-5518883e7e50 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-fb77b690-2ac3-4983-ae13-ce7e96237ff2-delete_snapshot'" released by "delete_snapshot" :: held 30.920s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:47:24.790916 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-858e20fa-3686-4107-84f5-7b63aeb55a30 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-c3da3e30-65ce-46fe-9a1b-e37b6bbdb0ad-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:47:24.792790 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-858e20fa-3686-4107-84f5-7b63aeb55a30 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:25.474729 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:47:25.495421 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Flow 'volume_create_manager' (95c444de-696b-4a3a-a538-6710505c9cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:47:25.502807 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89899b44-7bbf-435b-ba03-fb8214b1d586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:25.518275 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89899b44-7bbf-435b-ba03-fb8214b1d586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1531357915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=07e9f1ad-2e5e-4c0e-907f-ab51c873b678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfcde168250f4d16b2d305afed23fee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:47:25Z,use_quota=True,user_id='9771814136c84ab3a13bc98dfd79a40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:25.523916 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10a7737-b83e-4d54-857c-1e268ed4712b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:25.528165 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10a7737-b83e-4d54-857c-1e268ed4712b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:25.533660 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1c5cd9-c54f-41a3-b215-506d476ae472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:25.614963 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1c5cd9-c54f-41a3-b215-506d476ae472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '07e9f1ad-2e5e-4c0e-907f-ab51c873b678', 'volume_name': 'volume-07e9f1ad-2e5e-4c0e-907f-ab51c873b678', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7125f3640>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:25.620061 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983eb141-bdb1-43b3-9876-6ac070c5847c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:25.624087 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983eb141-bdb1-43b3-9876-6ac070c5847c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:25.628995 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1233bbdd-0d67-4192-bc2f-4ecdb463a440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:25.630131 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Volume 07e9f1ad-2e5e-4c0e-907f-ab51c873b678: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-07e9f1ad-2e5e-4c0e-907f-ab51c873b678', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7125f3640>}
Apr 16 21:47:25.630745 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Cloning 07e9f1ad-2e5e-4c0e-907f-ab51c873b678 from image 88bbe9a7-19d2-4102-9634-058b7c590848  at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 16 21:47:25.639600 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0c7df52f-d750-4d55-9811-0411840fc40f tempest-GroupSnapshotsTest-895991370 None] GroupSnapshot b97ffbda-4561-4dfa-9e8f-5a8ebabd4963: creating.
Apr 16 21:47:25.654091 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" acquired by "_prepare_image_cache_entry" :: waited 0.022s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:47:25.657599 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0c7df52f-d750-4d55-9811-0411840fc40f tempest-GroupSnapshotsTest-895991370 None] Group snapshot b97ffbda-4561-4dfa-9e8f-5a8ebabd4963: creating. {{(pid=130674) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}}
Apr 16 21:47:25.676291 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0c7df52f-d750-4d55-9811-0411840fc40f tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:25.833788 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 47, 25, 662785)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:47:25.834227 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:47:25.834626 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Found cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 16 21:47:25.838857 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" released by "_prepare_image_cache_entry" :: held 0.185s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:47:25.844328 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Attempting to retrieve cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 16 21:47:25.845926 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 47, 25, 843192)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:47:25.846335 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:47:25.846725 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Creating from source image-volume e0e222dd-75a5-4728-81e0-d352ad2a6247 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 16 21:47:25.857715 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:26.032986 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] creating snapshot='volume-07e9f1ad-2e5e-4c0e-907f-ab51c873b678.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:47:28.365059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] cloning 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247@volume-07e9f1ad-2e5e-4c0e-907f-ab51c873b678.clone_snap' to 'volume-07e9f1ad-2e5e-4c0e-907f-ab51c873b678' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:47:28.932360 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:47:28.933107 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:29.036412 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:29.057974 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:47:29.381811 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0c7df52f-d750-4d55-9811-0411840fc40f tempest-GroupSnapshotsTest-895991370 None] group_snapshot b97ffbda-4561-4dfa-9e8f-5a8ebabd4963: created successfully
Apr 16 21:47:29.741518 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:47:29.742892 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:47:29.743345 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:47:30.111691 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:47:30.112358 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Marking volume 07e9f1ad-2e5e-4c0e-907f-ab51c873b678 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:47:30.118955 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-12672774-2b0e-4e89-8e86-3099a584365e tempest-GroupSnapshotsTest-895991370 None] group_snapshot b97ffbda-4561-4dfa-9e8f-5a8ebabd4963: deleting
Apr 16 21:47:30.134737 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-12672774-2b0e-4e89-8e86-3099a584365e tempest-GroupSnapshotsTest-895991370 None] group_snapshot b97ffbda-4561-4dfa-9e8f-5a8ebabd4963: deleting {{(pid=130674) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}}
Apr 16 21:47:30.160730 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-12672774-2b0e-4e89-8e86-3099a584365e tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:30.531414 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Copying metadata from image 88bbe9a7-19d2-4102-9634-058b7c590848 to 07e9f1ad-2e5e-4c0e-907f-ab51c873b678. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 16 21:47:30.532081 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Creating volume glance metadata for volume 07e9f1ad-2e5e-4c0e-907f-ab51c873b678 backed by image 88bbe9a7-19d2-4102-9634-058b7c590848 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 16 21:47:30.659132 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1233bbdd-0d67-4192-bc2f-4ecdb463a440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07e9f1ad-2e5e-4c0e-907f-ab51c873b678', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc7125f3640>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:30.664085 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06815800-1b6f-45b7-ae7b-9753cdd3c2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:30.763742 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Volume volume-07e9f1ad-2e5e-4c0e-907f-ab51c873b678 (07e9f1ad-2e5e-4c0e-907f-ab51c873b678): created successfully
Apr 16 21:47:30.767490 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06815800-1b6f-45b7-ae7b-9753cdd3c2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:30.773202 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Flow 'volume_create_manager' (95c444de-696b-4a3a-a538-6710505c9cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:47:30.872189 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c02400b7-9bb0-4bb3-b3a3-65ff85f8c2dc tempest-TestVolumeBootPattern-410552364 None] Created volume successfully.
Apr 16 21:47:32.621756 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-12672774-2b0e-4e89-8e86-3099a584365e tempest-GroupSnapshotsTest-895991370 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2107439168 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2107439168, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:47:32.622626 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-12672774-2b0e-4e89-8e86-3099a584365e tempest-GroupSnapshotsTest-895991370 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2107439168 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2107439168, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:47:32.729740 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-12672774-2b0e-4e89-8e86-3099a584365e tempest-GroupSnapshotsTest-895991370 None] Created reservations ['36b8785d-8656-40ef-ae7a-2c67350e5248', 'dcd194e3-2df8-4301-9480-32c935774533', '3fe4c4b6-c92f-40a5-ae8d-58b98b247d66', 'e373a423-ccd3-4096-8850-cb97103c0b23'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:47:32.998594 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-12672774-2b0e-4e89-8e86-3099a584365e tempest-GroupSnapshotsTest-895991370 None] group_snapshot b97ffbda-4561-4dfa-9e8f-5a8ebabd4963: deleted successfully
Apr 16 21:47:33.611514 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ea89527d-87dc-4e8b-83f0-e082ee780240 tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:33.745482 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ea89527d-87dc-4e8b-83f0-e082ee780240 tempest-GroupSnapshotsTest-895991370 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:47:33.746056 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ea89527d-87dc-4e8b-83f0-e082ee780240 tempest-GroupSnapshotsTest-895991370 None] Volume volume-ac955ea0-3e7d-46f1-9af5-b0dbc9f2af3a is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:47:33.877836 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ea89527d-87dc-4e8b-83f0-e082ee780240 tempest-GroupSnapshotsTest-895991370 None] deleting rbd volume volume-ac955ea0-3e7d-46f1-9af5-b0dbc9f2af3a {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:47:34.684120 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-b5a47bf1-4297-4457-9fba-1af21ad623bd req-dc141f5d-9466-436b-bab5-c78dad6c5089 tempest-TestVolumeBootPattern-410552364 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:47:35.347790 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-b5a47bf1-4297-4457-9fba-1af21ad623bd req-dc141f5d-9466-436b-bab5-c78dad6c5089 tempest-TestVolumeBootPattern-410552364 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.664s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:47:35.348676 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-b5a47bf1-4297-4457-9fba-1af21ad623bd req-dc141f5d-9466-436b-bab5-c78dad6c5089 tempest-TestVolumeBootPattern-410552364 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-07e9f1ad-2e5e-4c0e-907f-ab51c873b678', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '07e9f1ad-2e5e-4c0e-907f-ab51c873b678', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:47:35.449700 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-b5a47bf1-4297-4457-9fba-1af21ad623bd req-dc141f5d-9466-436b-bab5-c78dad6c5089 tempest-TestVolumeBootPattern-410552364 None] Connection info returned from driver {'name': 'volumes/volume-07e9f1ad-2e5e-4c0e-907f-ab51c873b678', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '07e9f1ad-2e5e-4c0e-907f-ab51c873b678', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '94188eee-13fc-48e5-89c5-cc48a3345d59'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:47:35.534594 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-b5a47bf1-4297-4457-9fba-1af21ad623bd req-dc141f5d-9466-436b-bab5-c78dad6c5089 tempest-TestVolumeBootPattern-410552364 None] attachment_update completed successfully.
Apr 16 21:47:37.535089 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-ea89527d-87dc-4e8b-83f0-e082ee780240 tempest-GroupSnapshotsTest-895991370 None] Created reservations ['7b1ebac3-c50e-4c19-8433-2058d606cee2'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:47:37.555519 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-ea89527d-87dc-4e8b-83f0-e082ee780240 tempest-GroupSnapshotsTest-895991370 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2107439168 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2107439168, it is now deprecated. Please use the default quota class for default quota.
Apr 16 21:47:37.638477 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-ea89527d-87dc-4e8b-83f0-e082ee780240 tempest-GroupSnapshotsTest-895991370 None] Created reservations ['d9bdbb5d-db4b-42d2-bc59-fc4378e4fed8', '500e334f-36d7-4652-b208-03208ff1ab44', 'd0e25dcf-6f8d-4a82-bc63-39dc32549133', 'd34468ae-9a1a-4d98-b252-e747234324d9'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:47:37.983293 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ea89527d-87dc-4e8b-83f0-e082ee780240 tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:38.006592 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ea89527d-87dc-4e8b-83f0-e082ee780240 tempest-GroupSnapshotsTest-895991370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:38.028155 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-ea89527d-87dc-4e8b-83f0-e082ee780240 tempest-GroupSnapshotsTest-895991370 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:47:38.032065 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ea89527d-87dc-4e8b-83f0-e082ee780240 tempest-GroupSnapshotsTest-895991370 None] Delete group completed successfully.
Apr 16 21:47:44.218084 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fd35e0f2-f6db-40d6-a6d3-bd7f8e9609ff tempest-GroupsV320Test-1346764002 None] Group tempest-GroupsV320Test-Group-1073752902: creating
Apr 16 21:47:44.321983 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fd35e0f2-f6db-40d6-a6d3-bd7f8e9609ff tempest-GroupsV320Test-1346764002 None] Group tempest-GroupsV320Test-Group-1073752902: created successfully
Apr 16 21:47:44.333017 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fd35e0f2-f6db-40d6-a6d3-bd7f8e9609ff tempest-GroupsV320Test-1346764002 None] Create group completed successfully.
Apr 16 21:47:46.003668 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-47754097-8cb1-4135-8ab7-c3275b560788 tempest-GroupsV320Test-1346764002 None] Created reservations ['fbb87eab-6ebb-4bf2-b1ea-386e418fe143'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:47:46.212747 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-47754097-8cb1-4135-8ab7-c3275b560788 tempest-GroupsV320Test-1346764002 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:46.234184 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-47754097-8cb1-4135-8ab7-c3275b560788 tempest-GroupsV320Test-1346764002 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:46.256555 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-47754097-8cb1-4135-8ab7-c3275b560788 tempest-GroupsV320Test-1346764002 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:47:46.260515 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-47754097-8cb1-4135-8ab7-c3275b560788 tempest-GroupsV320Test-1346764002 None] Delete group completed successfully.
Apr 16 21:47:46.652065 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-d67cfc0c-32e8-4935-bb92-5423e03bb7cf req-7b8716a7-36dd-47df-9174-396f0a36d5f5 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:48.511818 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-d67cfc0c-32e8-4935-bb92-5423e03bb7cf req-7b8716a7-36dd-47df-9174-396f0a36d5f5 tempest-TestVolumeBootPattern-410552364 None] Create snapshot completed successfully
Apr 16 21:47:53.096039 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:47:53.135239 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Flow 'volume_create_manager' (11a5d876-0276-41d2-8db0-5c9dbe27ede9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:47:53.142536 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5c5e3c-5bcc-4d58-bae7-ea17fb1fdd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:53.159428 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5c5e3c-5bcc-4d58-bae7-ea17fb1fdd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:47:52Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ec6da470-0a1f-4364-ae4e-fd422a6b70dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfcde168250f4d16b2d305afed23fee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b98ad8a4-81cd-4741-bdff-771bedb7f94b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:47:53Z,use_quota=True,user_id='9771814136c84ab3a13bc98dfd79a40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:53.165970 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791972ed-141e-4fe2-af85-76045ff85ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:53.170437 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791972ed-141e-4fe2-af85-76045ff85ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:53.175868 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314834ec-4d39-4540-b736-b370ff4f6f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:53.180237 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314834ec-4d39-4540-b736-b370ff4f6f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ec6da470-0a1f-4364-ae4e-fd422a6b70dc', 'volume_name': 'volume-ec6da470-0a1f-4364-ae4e-fd422a6b70dc', 'volume_size': 1, 'snapshot_id': 'b98ad8a4-81cd-4741-bdff-771bedb7f94b'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:53.185463 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615de83f-14b7-4aa7-b0e4-56ea369fcdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:53.190064 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615de83f-14b7-4aa7-b0e4-56ea369fcdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:53.195017 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893345d0-0a82-4d70-8440-a003a4a1024f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:53.196541 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Volume ec6da470-0a1f-4364-ae4e-fd422a6b70dc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ec6da470-0a1f-4364-ae4e-fd422a6b70dc', 'volume_size': 1, 'snapshot_id': 'b98ad8a4-81cd-4741-bdff-771bedb7f94b'}
Apr 16 21:47:53.227666 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] cloning volumes/volume-07e9f1ad-2e5e-4c0e-907f-ab51c873b678@snapshot-b98ad8a4-81cd-4741-bdff-771bedb7f94b to volume-ec6da470-0a1f-4364-ae4e-fd422a6b70dc {{(pid=130674) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}}
Apr 16 21:47:53.228448 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:53.336319 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:55.014598 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:47:55.015962 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:47:55.039699 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Marking volume ec6da470-0a1f-4364-ae4e-fd422a6b70dc as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:47:55.180427 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Copying metadata from snapshot b98ad8a4-81cd-4741-bdff-771bedb7f94b to ec6da470-0a1f-4364-ae4e-fd422a6b70dc. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}}
Apr 16 21:47:55.275435 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893345d0-0a82-4d70-8440-a003a4a1024f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec6da470-0a1f-4364-ae4e-fd422a6b70dc', 'volume_size': 1, 'snapshot_id': 'b98ad8a4-81cd-4741-bdff-771bedb7f94b'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:55.279975 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a33557-00b3-4dc1-8671-d2d7a867801b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:55.351059 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Volume volume-ec6da470-0a1f-4364-ae4e-fd422a6b70dc (ec6da470-0a1f-4364-ae4e-fd422a6b70dc): created successfully
Apr 16 21:47:55.354997 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a33557-00b3-4dc1-8671-d2d7a867801b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:55.360947 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Flow 'volume_create_manager' (11a5d876-0276-41d2-8db0-5c9dbe27ede9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:47:55.426343 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-c112202d-cfcf-4198-92be-c6e87a034ce4 tempest-TestVolumeBootPattern-410552364 None] Created volume successfully.
Apr 16 21:47:56.032322 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-858e20fa-3686-4107-84f5-7b63aeb55a30 tempest-VolumesSnapshotTestJSON-2078807312 None] Created reservations ['56023a71-f6b9-47a9-bae7-ab1885b35540', 'b9533628-1fbc-42c7-a756-f5ccfea238f5', '1a3efad5-e7af-4f59-89fb-f45ca02c53d1', 'b3dfd30e-0191-4b56-9838-f417cd6ae950'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:47:56.221618 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-858e20fa-3686-4107-84f5-7b63aeb55a30 tempest-VolumesSnapshotTestJSON-2078807312 None] Delete snapshot completed successfully.
Apr 16 21:47:56.233201 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-858e20fa-3686-4107-84f5-7b63aeb55a30 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-c3da3e30-65ce-46fe-9a1b-e37b6bbdb0ad-delete_snapshot'" released by "delete_snapshot" :: held 31.442s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:47:56.343769 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-119b74c0-0932-4f58-b5e3-9789ee93991e tempest-TestVolumeBootPattern-410552364 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:47:56.970709 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-119b74c0-0932-4f58-b5e3-9789ee93991e tempest-TestVolumeBootPattern-410552364 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.626s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:47:56.972501 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-119b74c0-0932-4f58-b5e3-9789ee93991e tempest-TestVolumeBootPattern-410552364 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ec6da470-0a1f-4364-ae4e-fd422a6b70dc', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'ec6da470-0a1f-4364-ae4e-fd422a6b70dc', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:47:57.048879 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-119b74c0-0932-4f58-b5e3-9789ee93991e tempest-TestVolumeBootPattern-410552364 None] Connection info returned from driver {'name': 'volumes/volume-ec6da470-0a1f-4364-ae4e-fd422a6b70dc', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ec6da470-0a1f-4364-ae4e-fd422a6b70dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a0b0e913-336a-458f-9924-f2db40d7b3c0'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:47:57.146709 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-370f4171-19e1-4389-bfdc-0bcff56ec681 req-119b74c0-0932-4f58-b5e3-9789ee93991e tempest-TestVolumeBootPattern-410552364 None] attachment_update completed successfully.
Apr 16 21:47:57.426543 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-bfc4a5e2-d023-437a-abf3-6e916cb457a7 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-d5d9dd9b-166f-4ef9-8d3b-22b57a665607-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:47:57.428571 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bfc4a5e2-d023-437a-abf3-6e916cb457a7 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:57.799274 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:47:57.819195 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Flow 'volume_create_manager' (b7c2950d-edb6-4543-9287-eaf3f1a0e534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:47:57.825816 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9fa4b4-0c33-4727-a8ff-909bd5336eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:57.841285 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9fa4b4-0c33-4727-a8ff-909bd5336eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-846769138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fe31de02-52f7-40f8-8d1e-e479e8c72e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3f389405f041db937d8aa62bb20efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:47:58Z,use_quota=True,user_id='72e97c1749f1472a87a57eabf19678fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:57.846708 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6575a080-441a-40fd-9fbe-9af4e8575e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:57.851363 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6575a080-441a-40fd-9fbe-9af4e8575e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:57.856522 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8603e809-f132-4a33-be08-25b9c34bce6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:57.860627 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8603e809-f132-4a33-be08-25b9c34bce6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe31de02-52f7-40f8-8d1e-e479e8c72e54', 'volume_name': 'volume-fe31de02-52f7-40f8-8d1e-e479e8c72e54', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:57.866452 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074eeb72-3573-4fae-bac9-ecf42d56513f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:57.870424 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074eeb72-3573-4fae-bac9-ecf42d56513f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:57.875245 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f146847c-d227-47fd-9510-918b3716c1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:57.876371 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Volume fe31de02-52f7-40f8-8d1e-e479e8c72e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe31de02-52f7-40f8-8d1e-e479e8c72e54', 'volume_size': 1}
Apr 16 21:47:57.876773 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] creating volume 'volume-fe31de02-52f7-40f8-8d1e-e479e8c72e54' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:47:57.877619 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:47:58.567086 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:47:58.567735 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:47:58.573728 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f146847c-d227-47fd-9510-918b3716c1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe31de02-52f7-40f8-8d1e-e479e8c72e54', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:58.575997 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c227c14-b6f7-4fbc-93d9-a0d1cbdae774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:47:58.637543 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Volume volume-fe31de02-52f7-40f8-8d1e-e479e8c72e54 (fe31de02-52f7-40f8-8d1e-e479e8c72e54): created successfully
Apr 16 21:47:58.641354 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c227c14-b6f7-4fbc-93d9-a0d1cbdae774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:47:58.647852 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Flow 'volume_create_manager' (b7c2950d-edb6-4543-9287-eaf3f1a0e534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:47:58.700450 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9531dc95-a553-454e-8ce6-ccea810c83e7 tempest-VolumesTransfersTest-264687098 None] Created volume successfully.
Apr 16 21:48:00.670499 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-45f96f2c-b019-4f5f-85ad-e0d1b57c31e2 tempest-VolumesTransfersTest-1453511757 None] Transfer volume completed successfully.
Apr 16 21:48:01.562220 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-76d39654-3d75-441a-a48a-24d18076b89e tempest-VolumesTransfersTest-2114940830 None] Lock "b'cinder-fe31de02-52f7-40f8-8d1e-e479e8c72e54-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:48:01.649541 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-76d39654-3d75-441a-a48a-24d18076b89e tempest-VolumesTransfersTest-2114940830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:01.819749 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-76d39654-3d75-441a-a48a-24d18076b89e tempest-VolumesTransfersTest-2114940830 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:48:01.820408 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-76d39654-3d75-441a-a48a-24d18076b89e tempest-VolumesTransfersTest-2114940830 None] Volume volume-fe31de02-52f7-40f8-8d1e-e479e8c72e54 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:48:01.923318 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-76d39654-3d75-441a-a48a-24d18076b89e tempest-VolumesTransfersTest-2114940830 None] deleting rbd volume volume-fe31de02-52f7-40f8-8d1e-e479e8c72e54 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:48:04.979224 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-76d39654-3d75-441a-a48a-24d18076b89e tempest-VolumesTransfersTest-2114940830 None] Created reservations ['41e70d22-73a5-42cc-8a0b-989796a5e2b1', 'f680c6f5-ca37-44cb-9b66-c703089f8ac4', '04419a82-b3f7-4840-ad53-c6befc9ae213', 'b1d2cc14-041f-4d60-93bd-e13865f391d8'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:48:05.134677 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-76d39654-3d75-441a-a48a-24d18076b89e tempest-VolumesTransfersTest-2114940830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:05.156938 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-76d39654-3d75-441a-a48a-24d18076b89e tempest-VolumesTransfersTest-2114940830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:05.187515 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-76d39654-3d75-441a-a48a-24d18076b89e tempest-VolumesTransfersTest-2114940830 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:48:05.192449 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-76d39654-3d75-441a-a48a-24d18076b89e tempest-VolumesTransfersTest-2114940830 None] Deleted volume successfully.
Apr 16 21:48:05.263358 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-76d39654-3d75-441a-a48a-24d18076b89e tempest-VolumesTransfersTest-2114940830 None] Lock "b'cinder-fe31de02-52f7-40f8-8d1e-e479e8c72e54-delete_volume'" released by "delete_volume" :: held 3.702s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:48:06.701975 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:48:06.725841 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Flow 'volume_create_manager' (1c66a68f-bf8c-4f49-88b8-b02a2a28b691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:48:06.734843 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faba88c9-f152-48fa-97e3-73bfef40fae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:06.757969 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faba88c9-f152-48fa-97e3-73bfef40fae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-865872573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2067c673-553e-46af-879b-ce7d6cb7c6bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3f389405f041db937d8aa62bb20efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:48:07Z,use_quota=True,user_id='72e97c1749f1472a87a57eabf19678fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:06.761146 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d2fd9a3-d0cb-4f90-af8e-28fe2cdb2103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:06.765402 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d2fd9a3-d0cb-4f90-af8e-28fe2cdb2103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:06.771192 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2970f701-edaf-4914-a6bf-464020d1cae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:06.775347 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2970f701-edaf-4914-a6bf-464020d1cae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2067c673-553e-46af-879b-ce7d6cb7c6bf', 'volume_name': 'volume-2067c673-553e-46af-879b-ce7d6cb7c6bf', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:06.780387 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d731ea6-1b5c-4cc9-9194-94ee157b8152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:06.784385 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d731ea6-1b5c-4cc9-9194-94ee157b8152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:06.789199 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84eb94a-5d4a-418b-9ac7-89607f6fd191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:06.790314 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Volume 2067c673-553e-46af-879b-ce7d6cb7c6bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2067c673-553e-46af-879b-ce7d6cb7c6bf', 'volume_size': 1}
Apr 16 21:48:06.790723 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] creating volume 'volume-2067c673-553e-46af-879b-ce7d6cb7c6bf' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:48:06.791513 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:07.795750 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:48:07.796459 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:48:07.799890 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84eb94a-5d4a-418b-9ac7-89607f6fd191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2067c673-553e-46af-879b-ce7d6cb7c6bf', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:07.805438 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881f2e5d-6dc6-4547-86b5-78b6918b50d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:07.883333 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Volume volume-2067c673-553e-46af-879b-ce7d6cb7c6bf (2067c673-553e-46af-879b-ce7d6cb7c6bf): created successfully
Apr 16 21:48:07.887046 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881f2e5d-6dc6-4547-86b5-78b6918b50d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:07.892810 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Flow 'volume_create_manager' (1c66a68f-bf8c-4f49-88b8-b02a2a28b691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:48:07.974700 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9ec79c2c-a1b0-4d6e-9218-f30e4a5e2d98 tempest-VolumesTransfersTest-264687098 None] Created volume successfully.
Apr 16 21:48:09.361182 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-bec53d18-ffc5-4903-9fa9-08836d3c856f tempest-VolumesTransfersTest-2114940830 None] Lock "b'cinder-2067c673-553e-46af-879b-ce7d6cb7c6bf-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:48:09.449466 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bec53d18-ffc5-4903-9fa9-08836d3c856f tempest-VolumesTransfersTest-2114940830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:09.694103 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bec53d18-ffc5-4903-9fa9-08836d3c856f tempest-VolumesTransfersTest-2114940830 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:48:09.694760 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bec53d18-ffc5-4903-9fa9-08836d3c856f tempest-VolumesTransfersTest-2114940830 None] Volume volume-2067c673-553e-46af-879b-ce7d6cb7c6bf is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:48:09.779567 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bec53d18-ffc5-4903-9fa9-08836d3c856f tempest-VolumesTransfersTest-2114940830 None] deleting rbd volume volume-2067c673-553e-46af-879b-ce7d6cb7c6bf {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:48:10.737504 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 req-f719ca67-7f3b-47a6-90cc-3dd17edc7503 tempest-TestVolumeBootPattern-410552364 None] Terminate volume connection completed successfully.
Apr 16 21:48:10.738164 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 req-f719ca67-7f3b-47a6-90cc-3dd17edc7503 tempest-TestVolumeBootPattern-410552364 None] Deleting attachment a0b0e913-336a-458f-9924-f2db40d7b3c0. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:48:11.064668 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 req-a8239243-6042-4975-b487-8f2d47da55b7 tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-ec6da470-0a1f-4364-ae4e-fd422a6b70dc-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:48:11.140423 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 req-a8239243-6042-4975-b487-8f2d47da55b7 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:11.344794 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 req-a8239243-6042-4975-b487-8f2d47da55b7 tempest-TestVolumeBootPattern-410552364 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:48:11.622316 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 req-a8239243-6042-4975-b487-8f2d47da55b7 tempest-TestVolumeBootPattern-410552364 None] deleting rbd volume volume-ec6da470-0a1f-4364-ae4e-fd422a6b70dc {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:48:15.860185 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-bec53d18-ffc5-4903-9fa9-08836d3c856f tempest-VolumesTransfersTest-2114940830 None] Created reservations ['e067692a-d2b1-45f8-837b-c085f2037c6c', 'bf1814df-5f14-4840-abcd-e1aeb0d03a46', '6c7a9320-f3f6-4de2-914f-601ea9f0ec52', '66f70aab-db22-46ba-bb93-c2aa5ec85ffe'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:48:16.071047 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bec53d18-ffc5-4903-9fa9-08836d3c856f tempest-VolumesTransfersTest-2114940830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:16.092605 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bec53d18-ffc5-4903-9fa9-08836d3c856f tempest-VolumesTransfersTest-2114940830 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:16.115020 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-bec53d18-ffc5-4903-9fa9-08836d3c856f tempest-VolumesTransfersTest-2114940830 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:48:16.118968 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-bec53d18-ffc5-4903-9fa9-08836d3c856f tempest-VolumesTransfersTest-2114940830 None] Deleted volume successfully.
Apr 16 21:48:16.213132 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-bec53d18-ffc5-4903-9fa9-08836d3c856f tempest-VolumesTransfersTest-2114940830 None] Lock "b'cinder-2067c673-553e-46af-879b-ce7d6cb7c6bf-delete_volume'" released by "delete_volume" :: held 6.852s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:48:18.847582 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 req-a8239243-6042-4975-b487-8f2d47da55b7 tempest-TestVolumeBootPattern-410552364 None] Created reservations ['87681762-4d3d-48e7-a5d1-693ce3466493', 'e3b4354b-8034-4bc0-8779-db3f418966a7', 'ba6534ec-5155-4329-9a27-850363b13026', '22c35c5d-eccb-46bb-a52d-50008478477f'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:48:18.997935 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 req-a8239243-6042-4975-b487-8f2d47da55b7 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:19.041864 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 req-a8239243-6042-4975-b487-8f2d47da55b7 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:19.070383 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 req-a8239243-6042-4975-b487-8f2d47da55b7 tempest-TestVolumeBootPattern-410552364 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:48:19.074977 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 req-a8239243-6042-4975-b487-8f2d47da55b7 tempest-TestVolumeBootPattern-410552364 None] Deleted volume successfully.
Apr 16 21:48:19.166183 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 req-a8239243-6042-4975-b487-8f2d47da55b7 tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-ec6da470-0a1f-4364-ae4e-fd422a6b70dc-delete_volume'" released by "delete_volume" :: held 8.102s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:48:19.506800 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3553a176-1004-4918-a48d-9c1deef0af68 tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-b98ad8a4-81cd-4741-bdff-771bedb7f94b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:48:19.508458 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3553a176-1004-4918-a48d-9c1deef0af68 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:22.135569 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:48:22.157144 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Flow 'volume_create_manager' (6599af1c-b1b1-407c-8ad5-79302ecc2c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:48:22.164318 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb0a8d8-7e8e-47b1-8e5b-83b2722d2bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:22.179931 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb0a8d8-7e8e-47b1-8e5b-83b2722d2bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-59004240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=277643c8-e229-4a42-9dab-8ebf5d0634e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='475ffde0ba2f432b918f959d413bb874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:48:22Z,use_quota=True,user_id='de128399333c4a2481f61c2f0b5f310b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:22.185414 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64fa022f-7892-4c52-97ea-a000835b4ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:22.195508 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64fa022f-7892-4c52-97ea-a000835b4ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:22.195508 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d464f19a-d6af-44c0-8e1b-9a7117a6d238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:22.198818 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d464f19a-d6af-44c0-8e1b-9a7117a6d238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '277643c8-e229-4a42-9dab-8ebf5d0634e2', 'volume_name': 'volume-277643c8-e229-4a42-9dab-8ebf5d0634e2', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:22.203814 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4bfaaf-6442-4386-9e07-f29a3c21c698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:22.207788 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4bfaaf-6442-4386-9e07-f29a3c21c698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:22.213147 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde37557-da69-4bc3-9121-5aa59b9d6da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:22.214228 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Volume 277643c8-e229-4a42-9dab-8ebf5d0634e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-277643c8-e229-4a42-9dab-8ebf5d0634e2', 'volume_size': 1}
Apr 16 21:48:22.214621 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] creating volume 'volume-277643c8-e229-4a42-9dab-8ebf5d0634e2' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:48:22.215397 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:23.222312 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:48:23.222936 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:48:23.226588 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde37557-da69-4bc3-9121-5aa59b9d6da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-277643c8-e229-4a42-9dab-8ebf5d0634e2', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:23.231432 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9bb9dca-c6f2-4fa7-a339-70bdb6e4d022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:23.328214 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Volume volume-277643c8-e229-4a42-9dab-8ebf5d0634e2 (277643c8-e229-4a42-9dab-8ebf5d0634e2): created successfully
Apr 16 21:48:23.331944 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9bb9dca-c6f2-4fa7-a339-70bdb6e4d022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:23.338356 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Flow 'volume_create_manager' (6599af1c-b1b1-407c-8ad5-79302ecc2c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:48:23.442319 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-90b21557-0816-4332-820e-1a57adac1a1a tempest-VolumesBackupsV39Test-2016061415 None] Created volume successfully.
Apr 16 21:48:24.689128 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1e172218-4f9f-4338-bea6-1b90048f21e7 tempest-VolumesBackupsV39Test-2016061415 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-16T21:48:24Z,data_timestamp=2022-04-16T21:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-281360062',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=d25e3166-72cc-45f7-9af4-7f91b9cbcd3f,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='475ffde0ba2f432b918f959d413bb874',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='de128399333c4a2481f61c2f0b5f310b',volume_id=277643c8-e229-4a42-9dab-8ebf5d0634e2)
Apr 16 21:48:24.689898 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.backup.rpcapi [None req-1e172218-4f9f-4338-bea6-1b90048f21e7 tempest-VolumesBackupsV39Test-2016061415 None] continue_backup in rpcapi backup_id d25e3166-72cc-45f7-9af4-7f91b9cbcd3f {{(pid=130674) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Apr 16 21:48:24.802777 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-1e172218-4f9f-4338-bea6-1b90048f21e7 tempest-VolumesBackupsV39Test-2016061415 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:48:25.437543 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-1e172218-4f9f-4338-bea6-1b90048f21e7 tempest-VolumesBackupsV39Test-2016061415 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.634s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:48:25.438514 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1e172218-4f9f-4338-bea6-1b90048f21e7 tempest-VolumesBackupsV39Test-2016061415 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-277643c8-e229-4a42-9dab-8ebf5d0634e2', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '277643c8-e229-4a42-9dab-8ebf5d0634e2', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:48:25.451947 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1e172218-4f9f-4338-bea6-1b90048f21e7 tempest-VolumesBackupsV39Test-2016061415 None] Initialize volume connection completed successfully.
Apr 16 21:48:28.727313 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-bfc4a5e2-d023-437a-abf3-6e916cb457a7 tempest-VolumesSnapshotTestJSON-2078807312 None] Created reservations ['58d8bcf9-bf90-4ffd-bab9-febf754b67bf', 'ac8017be-7aea-438e-a1cb-a2da1557a484', '5a304768-6f86-48f8-8bf8-e7e3ae82a351', '589f84ed-016f-4d62-852f-9c54166a71ad'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:48:28.916466 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-bfc4a5e2-d023-437a-abf3-6e916cb457a7 tempest-VolumesSnapshotTestJSON-2078807312 None] Delete snapshot completed successfully.
Apr 16 21:48:28.921527 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-bfc4a5e2-d023-437a-abf3-6e916cb457a7 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-d5d9dd9b-166f-4ef9-8d3b-22b57a665607-delete_snapshot'" released by "delete_snapshot" :: held 31.495s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:48:28.932749 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:48:28.933924 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:28.957417 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:28.979735 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:48:30.324922 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-b0f5f58c-25ff-4750-b625-1ba3ca1e4025 req-1430c832-5ad1-499b-adbd-fea4dbbfa68a tempest-VolumesSnapshotTestJSON-2078807312 None] Terminate volume connection completed successfully.
Apr 16 21:48:30.325552 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-b0f5f58c-25ff-4750-b625-1ba3ca1e4025 req-1430c832-5ad1-499b-adbd-fea4dbbfa68a tempest-VolumesSnapshotTestJSON-2078807312 None] Deleting attachment b6f12e3c-8924-4cf6-86b6-af2504018ad5. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:48:33.721049 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1e172218-4f9f-4338-bea6-1b90048f21e7 tempest-VolumesBackupsV39Test-2016061415 None] Terminate volume connection completed successfully.
Apr 16 21:48:33.738338 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1e172218-4f9f-4338-bea6-1b90048f21e7 tempest-VolumesBackupsV39Test-2016061415 None] Remove volume export completed successfully.
Apr 16 21:48:35.306478 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:48:35.326099 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Flow 'volume_create_manager' (cbaa3ddb-bc58-4c28-a364-c3802e98a2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:48:35.333058 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226cf0c5-6d66-4dce-be1d-b03e431296ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:35.350523 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226cf0c5-6d66-4dce-be1d-b03e431296ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-918219202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fc253b4e-34fa-49aa-beb6-7a46c380c294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda4f5ee41d2439e935ee0f658f465d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:48:35Z,use_quota=True,user_id='95bf99de7a594e209f995e62db441850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:35.355930 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2db9a6-1296-4a80-8790-d34a402e1c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:35.360234 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2db9a6-1296-4a80-8790-d34a402e1c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:35.366405 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b73939f-846e-4267-acb1-a2f199e2c79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:35.370500 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b73939f-846e-4267-acb1-a2f199e2c79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc253b4e-34fa-49aa-beb6-7a46c380c294', 'volume_name': 'volume-fc253b4e-34fa-49aa-beb6-7a46c380c294', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:35.375453 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6938b74c-b565-4a48-b9e5-aa8f26e99f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:35.379381 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6938b74c-b565-4a48-b9e5-aa8f26e99f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:35.384154 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae60940-fd90-4194-b327-58820057b653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:35.390941 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Volume fc253b4e-34fa-49aa-beb6-7a46c380c294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc253b4e-34fa-49aa-beb6-7a46c380c294', 'volume_size': 1}
Apr 16 21:48:35.390941 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] creating volume 'volume-fc253b4e-34fa-49aa-beb6-7a46c380c294' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:48:35.390941 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:36.376383 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:48:36.377079 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:48:36.381253 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae60940-fd90-4194-b327-58820057b653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc253b4e-34fa-49aa-beb6-7a46c380c294', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:36.385931 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552bb6cb-39ed-4fcf-b207-b269c5e22e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:36.464681 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Volume volume-fc253b4e-34fa-49aa-beb6-7a46c380c294 (fc253b4e-34fa-49aa-beb6-7a46c380c294): created successfully
Apr 16 21:48:36.468372 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552bb6cb-39ed-4fcf-b207-b269c5e22e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:36.474127 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Flow 'volume_create_manager' (cbaa3ddb-bc58-4c28-a364-c3802e98a2bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:48:36.538359 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-540cac05-b126-4425-a028-60a5cbb01ad3 tempest-VolumesSnapshotTestJSON-2078807312 None] Created volume successfully.
Apr 16 21:48:37.745081 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-efc01fbd-6379-45ab-a33e-774f3e6bd448 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:40.727059 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-efc01fbd-6379-45ab-a33e-774f3e6bd448 tempest-VolumesSnapshotTestJSON-2078807312 None] Create snapshot completed successfully
Apr 16 21:48:42.437200 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:48:42.464934 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Flow 'volume_create_manager' (53c3db91-07a7-4de8-a609-01cd82168773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:48:42.471613 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff8864b-c36d-49cc-9323-f290dd9697d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:42.487466 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff8864b-c36d-49cc-9323-f290dd9697d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-541801608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=bd0361be-b1f2-4f26-892d-6f1ec18b5a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda4f5ee41d2439e935ee0f658f465d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:48:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=76be6301-032b-4101-9700-2929e6625298,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:48:42Z,use_quota=True,user_id='95bf99de7a594e209f995e62db441850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:42.493586 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f3fc1b-82c5-4199-8c14-e1ec08b400fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:42.497876 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f3fc1b-82c5-4199-8c14-e1ec08b400fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:42.503141 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8dbb977-ae71-42d0-ac56-13ab07e3c9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:42.508054 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8dbb977-ae71-42d0-ac56-13ab07e3c9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bd0361be-b1f2-4f26-892d-6f1ec18b5a84', 'volume_name': 'volume-bd0361be-b1f2-4f26-892d-6f1ec18b5a84', 'volume_size': 2, 'snapshot_id': '76be6301-032b-4101-9700-2929e6625298'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:42.513193 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0767f8fd-9c3c-4fac-8fdf-7a7b43277183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:42.517257 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0767f8fd-9c3c-4fac-8fdf-7a7b43277183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:42.522193 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fda88a8-6730-46f9-acf4-91b43578a52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:42.523301 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Volume bd0361be-b1f2-4f26-892d-6f1ec18b5a84: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bd0361be-b1f2-4f26-892d-6f1ec18b5a84', 'volume_size': 2, 'snapshot_id': '76be6301-032b-4101-9700-2929e6625298'}
Apr 16 21:48:42.541937 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] cloning volumes/volume-fc253b4e-34fa-49aa-beb6-7a46c380c294@snapshot-76be6301-032b-4101-9700-2929e6625298 to volume-bd0361be-b1f2-4f26-892d-6f1ec18b5a84 {{(pid=130674) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}}
Apr 16 21:48:42.542566 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:42.584749 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:44.474972 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:48:44.475684 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:48:44.479211 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:46.215328 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fda88a8-6730-46f9-acf4-91b43578a52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0361be-b1f2-4f26-892d-6f1ec18b5a84', 'volume_size': 2, 'snapshot_id': '76be6301-032b-4101-9700-2929e6625298'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:46.219997 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d53a8b-21cd-41e9-ae8d-966454ea6541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:46.275777 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Volume volume-bd0361be-b1f2-4f26-892d-6f1ec18b5a84 (bd0361be-b1f2-4f26-892d-6f1ec18b5a84): created successfully
Apr 16 21:48:46.279546 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d53a8b-21cd-41e9-ae8d-966454ea6541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:46.285324 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Flow 'volume_create_manager' (53c3db91-07a7-4de8-a609-01cd82168773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:48:46.350519 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6e386d9e-8915-4c73-a523-6f1392eabcec tempest-VolumesSnapshotTestJSON-2078807312 None] Created volume successfully.
Apr 16 21:48:46.754585 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f96aa343-4c87-444d-86bb-823ab112363b tempest-VolumesBackupsV39Test-2016061415 None] Lock "b'cinder-277643c8-e229-4a42-9dab-8ebf5d0634e2-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:48:46.816847 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-89a29b91-c94b-4439-96fd-50801c2d23fd tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-bd0361be-b1f2-4f26-892d-6f1ec18b5a84-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:48:46.843253 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f96aa343-4c87-444d-86bb-823ab112363b tempest-VolumesBackupsV39Test-2016061415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:49.462695 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f96aa343-4c87-444d-86bb-823ab112363b tempest-VolumesBackupsV39Test-2016061415 None] Volume volume-277643c8-e229-4a42-9dab-8ebf5d0634e2 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:48:50.013688 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f96aa343-4c87-444d-86bb-823ab112363b tempest-VolumesBackupsV39Test-2016061415 None] deleting rbd volume volume-277643c8-e229-4a42-9dab-8ebf5d0634e2 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:48:50.033558 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-89a29b91-c94b-4439-96fd-50801c2d23fd tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:50.207065 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-89a29b91-c94b-4439-96fd-50801c2d23fd tempest-VolumesSnapshotTestJSON-2078807312 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:48:50.419605 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-89a29b91-c94b-4439-96fd-50801c2d23fd tempest-VolumesSnapshotTestJSON-2078807312 None] deleting rbd volume volume-bd0361be-b1f2-4f26-892d-6f1ec18b5a84 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:48:51.264889 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-3553a176-1004-4918-a48d-9c1deef0af68 tempest-TestVolumeBootPattern-410552364 None] Created reservations ['7c80ef73-be5a-4cdd-9670-a8d6f43e4d4f', 'b222c466-392a-423c-95b5-cf226757c2b1', '9273697f-2908-4ff8-b925-eade1bb6a322', 'c82b8820-9f12-4a97-a24c-1c2314f0da0a'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:48:51.458809 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3553a176-1004-4918-a48d-9c1deef0af68 tempest-TestVolumeBootPattern-410552364 None] Delete snapshot completed successfully.
Apr 16 21:48:51.464642 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3553a176-1004-4918-a48d-9c1deef0af68 tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-b98ad8a4-81cd-4741-bdff-771bedb7f94b-delete_snapshot'" released by "delete_snapshot" :: held 31.958s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:48:54.086641 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-0c11dc43-6c6b-4d6e-992a-63299bda151d req-107a332e-fac1-4983-8f66-32278305e8b5 tempest-TestVolumeBootPattern-410552364 None] Terminate volume connection completed successfully.
Apr 16 21:48:54.087104 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-0c11dc43-6c6b-4d6e-992a-63299bda151d req-107a332e-fac1-4983-8f66-32278305e8b5 tempest-TestVolumeBootPattern-410552364 None] Deleting attachment 94188eee-13fc-48e5-89c5-cc48a3345d59. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:48:54.444909 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-0c11dc43-6c6b-4d6e-992a-63299bda151d req-c737e227-19a3-405b-9171-2a37984ea441 tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-07e9f1ad-2e5e-4c0e-907f-ab51c873b678-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:48:54.533523 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-0c11dc43-6c6b-4d6e-992a-63299bda151d req-c737e227-19a3-405b-9171-2a37984ea441 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:54.755320 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-0c11dc43-6c6b-4d6e-992a-63299bda151d req-c737e227-19a3-405b-9171-2a37984ea441 tempest-TestVolumeBootPattern-410552364 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:48:54.939944 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-0c11dc43-6c6b-4d6e-992a-63299bda151d req-c737e227-19a3-405b-9171-2a37984ea441 tempest-TestVolumeBootPattern-410552364 None] deleting rbd volume volume-07e9f1ad-2e5e-4c0e-907f-ab51c873b678 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:48:55.681468 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-f96aa343-4c87-444d-86bb-823ab112363b tempest-VolumesBackupsV39Test-2016061415 None] Created reservations ['f99b8b96-099e-44de-86dc-01d7daa5b04b', '4b44317a-c81e-4cbf-b6fd-48e808f8dcad', '7d86c907-0ec5-4afe-9ed7-4399956557e2', 'd51dc682-056a-4908-81ae-dca1811a2329'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:48:55.853524 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f96aa343-4c87-444d-86bb-823ab112363b tempest-VolumesBackupsV39Test-2016061415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:55.875713 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f96aa343-4c87-444d-86bb-823ab112363b tempest-VolumesBackupsV39Test-2016061415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:55.899141 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-f96aa343-4c87-444d-86bb-823ab112363b tempest-VolumesBackupsV39Test-2016061415 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:48:55.903265 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f96aa343-4c87-444d-86bb-823ab112363b tempest-VolumesBackupsV39Test-2016061415 None] Deleted volume successfully.
Apr 16 21:48:55.971630 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f96aa343-4c87-444d-86bb-823ab112363b tempest-VolumesBackupsV39Test-2016061415 None] Lock "b'cinder-277643c8-e229-4a42-9dab-8ebf5d0634e2-delete_volume'" released by "delete_volume" :: held 9.252s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:48:56.132828 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-89a29b91-c94b-4439-96fd-50801c2d23fd tempest-VolumesSnapshotTestJSON-2078807312 None] Created reservations ['0f0e6776-3d96-4366-b972-dc81d7419a53', 'eebbcb3d-558a-4b7d-92a1-f177db3c27c3', '31f09ac1-af86-4cb2-b178-1adcd67b9251', 'c4f62d69-f604-4f72-a21e-36b1af01080a'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:48:56.306535 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-89a29b91-c94b-4439-96fd-50801c2d23fd tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:56.382322 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-89a29b91-c94b-4439-96fd-50801c2d23fd tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:56.407390 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-89a29b91-c94b-4439-96fd-50801c2d23fd tempest-VolumesSnapshotTestJSON-2078807312 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:48:56.411348 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-89a29b91-c94b-4439-96fd-50801c2d23fd tempest-VolumesSnapshotTestJSON-2078807312 None] Deleted volume successfully.
Apr 16 21:48:56.611494 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-89a29b91-c94b-4439-96fd-50801c2d23fd tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-bd0361be-b1f2-4f26-892d-6f1ec18b5a84-delete_volume'" released by "delete_volume" :: held 9.795s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:48:57.162958 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:48:57.183039 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Flow 'volume_create_manager' (0a4bf304-e795-48d6-a927-ccd4e8f2e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:48:57.190457 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300ddb1d-cba0-47a3-b034-48dfb73ef008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:57.205511 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300ddb1d-cba0-47a3-b034-48dfb73ef008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1546389842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3058e8d0-fbda-4d13-9d0a-c92547a50d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda4f5ee41d2439e935ee0f658f465d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:48:57Z,use_quota=True,user_id='95bf99de7a594e209f995e62db441850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:57.211030 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a6008b-a6e5-4687-b258-a590cbd4c5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:57.215237 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a6008b-a6e5-4687-b258-a590cbd4c5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:57.220805 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f724cedf-8baf-4511-ba1d-763e389c8178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:57.225033 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f724cedf-8baf-4511-ba1d-763e389c8178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3058e8d0-fbda-4d13-9d0a-c92547a50d0a', 'volume_name': 'volume-3058e8d0-fbda-4d13-9d0a-c92547a50d0a', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:57.230446 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2cf028c-a64b-4c0f-ac63-b5e52bf3096b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:57.235259 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2cf028c-a64b-4c0f-ac63-b5e52bf3096b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:57.240128 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965fcb9e-3a09-4f27-9ec8-50a5574eff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:57.241263 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Volume 3058e8d0-fbda-4d13-9d0a-c92547a50d0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3058e8d0-fbda-4d13-9d0a-c92547a50d0a', 'volume_size': 1}
Apr 16 21:48:57.242093 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] creating volume 'volume-3058e8d0-fbda-4d13-9d0a-c92547a50d0a' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:48:57.242459 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:58.072675 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:48:58.073064 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:48:58.076929 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965fcb9e-3a09-4f27-9ec8-50a5574eff97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3058e8d0-fbda-4d13-9d0a-c92547a50d0a', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:58.081640 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d277b2e6-f4fa-484b-8325-841e51b445b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:58.161192 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Volume volume-3058e8d0-fbda-4d13-9d0a-c92547a50d0a (3058e8d0-fbda-4d13-9d0a-c92547a50d0a): created successfully
Apr 16 21:48:58.165522 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d277b2e6-f4fa-484b-8325-841e51b445b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:58.171019 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Flow 'volume_create_manager' (0a4bf304-e795-48d6-a927-ccd4e8f2e35d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:48:58.229798 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7be68b53-52fa-4208-9b19-bcb8935c840c tempest-VolumesSnapshotTestJSON-2078807312 None] Created volume successfully.
Apr 16 21:48:59.237399 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:48:59.258161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Flow 'volume_create_manager' (ce1e81e8-2326-4366-ab5a-c6308f14e14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:48:59.265339 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80801db-ffbe-46c4-a852-6aa0d3716454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:59.280548 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80801db-ffbe-46c4-a852-6aa0d3716454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1485354503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6622d347-5a64-4343-95b5-e2d44b5ffd02,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1c4a83e6ef848c4bcff3c997bedecd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:48:59Z,use_quota=True,user_id='7bf6b6d1defa4c89a6eec189ac0dd358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:59.286019 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a791576a-2300-4938-b2a6-0ab512052e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:59.290189 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a791576a-2300-4938-b2a6-0ab512052e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:59.295926 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11442fd4-920a-41ff-ada8-d1cbcbf8256a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:59.300098 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11442fd4-920a-41ff-ada8-d1cbcbf8256a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6622d347-5a64-4343-95b5-e2d44b5ffd02', 'volume_name': 'volume-6622d347-5a64-4343-95b5-e2d44b5ffd02', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:59.305250 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f0abb7-005f-4f77-81af-0e0133e63d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:59.309226 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f0abb7-005f-4f77-81af-0e0133e63d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:48:59.314657 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8503564d-dff2-495a-a33a-4db1d44a1e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:48:59.315773 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Volume 6622d347-5a64-4343-95b5-e2d44b5ffd02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6622d347-5a64-4343-95b5-e2d44b5ffd02', 'volume_size': 1}
Apr 16 21:48:59.316161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] creating volume 'volume-6622d347-5a64-4343-95b5-e2d44b5ffd02' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:48:59.316836 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:48:59.528606 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c6ab6def-6369-4949-8bd4-a966765b37be tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:00.113340 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:49:00.113820 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:49:00.117565 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8503564d-dff2-495a-a33a-4db1d44a1e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6622d347-5a64-4343-95b5-e2d44b5ffd02', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:00.122161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059a6687-d629-45d9-8242-844d27d57433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:00.172790 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Volume volume-6622d347-5a64-4343-95b5-e2d44b5ffd02 (6622d347-5a64-4343-95b5-e2d44b5ffd02): created successfully
Apr 16 21:49:00.176642 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059a6687-d629-45d9-8242-844d27d57433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:00.182172 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Flow 'volume_create_manager' (ce1e81e8-2326-4366-ab5a-c6308f14e14b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:49:00.235663 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-467abd50-c7d8-47a4-bd5d-6689998629f8 tempest-VolumesListTestJSON-335088165 None] Created volume successfully.
Apr 16 21:49:00.238268 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-0c11dc43-6c6b-4d6e-992a-63299bda151d req-c737e227-19a3-405b-9171-2a37984ea441 tempest-TestVolumeBootPattern-410552364 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:49:00.345229 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-0c11dc43-6c6b-4d6e-992a-63299bda151d req-c737e227-19a3-405b-9171-2a37984ea441 tempest-TestVolumeBootPattern-410552364 None] deleting parent snapshot volume-07e9f1ad-2e5e-4c0e-907f-ab51c873b678.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:49:03.168217 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:49:03.200524 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Flow 'volume_create_manager' (fe46c072-e169-4542-919b-0a6357b1e061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:49:03.211786 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0ae600-9b41-40fa-a23e-f39e9d0a8f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:03.228135 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0ae600-9b41-40fa-a23e-f39e9d0a8f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-962256830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5003f8cf-c5ed-419e-ad74-e9afea0abf5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1c4a83e6ef848c4bcff3c997bedecd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:49:02Z,use_quota=True,user_id='7bf6b6d1defa4c89a6eec189ac0dd358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:03.233657 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa559d5b-3ebb-4c7b-ac45-97cab8013b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:03.238066 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa559d5b-3ebb-4c7b-ac45-97cab8013b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:03.243284 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e963d1-5064-4360-aff1-c26db289a260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:03.247524 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e963d1-5064-4360-aff1-c26db289a260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5003f8cf-c5ed-419e-ad74-e9afea0abf5c', 'volume_name': 'volume-5003f8cf-c5ed-419e-ad74-e9afea0abf5c', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:03.252541 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4753d2-a95c-435f-8436-46adb7d855c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:03.256529 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4753d2-a95c-435f-8436-46adb7d855c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:03.261292 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cc1b7d-60c6-4e04-947a-0540ae936567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:03.262359 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Volume 5003f8cf-c5ed-419e-ad74-e9afea0abf5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5003f8cf-c5ed-419e-ad74-e9afea0abf5c', 'volume_size': 1}
Apr 16 21:49:03.262741 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] creating volume 'volume-5003f8cf-c5ed-419e-ad74-e9afea0abf5c' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:49:03.264323 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:03.285557 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-0c11dc43-6c6b-4d6e-992a-63299bda151d req-c737e227-19a3-405b-9171-2a37984ea441 tempest-TestVolumeBootPattern-410552364 None] Created reservations ['0593e0bc-85be-417c-90ec-f4f291cc90cc', 'ca49f1bd-da2b-4b4d-8976-75456b4708b2', '675025f9-cdfa-468f-9670-474c9f0dc4e2', 'f02570d7-a0d6-442a-b4e3-9312bea016c3'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:49:03.493117 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-0c11dc43-6c6b-4d6e-992a-63299bda151d req-c737e227-19a3-405b-9171-2a37984ea441 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:03.519315 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-0c11dc43-6c6b-4d6e-992a-63299bda151d req-c737e227-19a3-405b-9171-2a37984ea441 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:03.540709 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-0c11dc43-6c6b-4d6e-992a-63299bda151d req-c737e227-19a3-405b-9171-2a37984ea441 tempest-TestVolumeBootPattern-410552364 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:49:03.544932 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-0c11dc43-6c6b-4d6e-992a-63299bda151d req-c737e227-19a3-405b-9171-2a37984ea441 tempest-TestVolumeBootPattern-410552364 None] Deleted volume successfully.
Apr 16 21:49:03.604801 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-0c11dc43-6c6b-4d6e-992a-63299bda151d req-c737e227-19a3-405b-9171-2a37984ea441 tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-07e9f1ad-2e5e-4c0e-907f-ab51c873b678-delete_volume'" released by "delete_volume" :: held 9.160s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:49:03.949609 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c6ab6def-6369-4949-8bd4-a966765b37be tempest-VolumesSnapshotTestJSON-2078807312 None] Create snapshot completed successfully
Apr 16 21:49:04.163896 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:49:04.164325 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:49:04.168369 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cc1b7d-60c6-4e04-947a-0540ae936567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5003f8cf-c5ed-419e-ad74-e9afea0abf5c', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:04.173579 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fbdb07b-6709-4ccc-882b-741dbf12eccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:04.241008 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Volume volume-5003f8cf-c5ed-419e-ad74-e9afea0abf5c (5003f8cf-c5ed-419e-ad74-e9afea0abf5c): created successfully
Apr 16 21:49:04.244771 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fbdb07b-6709-4ccc-882b-741dbf12eccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:04.250455 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Flow 'volume_create_manager' (fe46c072-e169-4542-919b-0a6357b1e061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:49:04.332251 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-17cc28f7-614a-4921-a62b-5047d1d4ef83 tempest-VolumesListTestJSON-335088165 None] Created volume successfully.
Apr 16 21:49:05.317272 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:49:05.349502 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Flow 'volume_create_manager' (64efffd2-6746-4d3c-bcd0-c08945b3cb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:49:05.355317 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79adb62-f3af-4301-87a6-817a46dffc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:05.372052 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79adb62-f3af-4301-87a6-817a46dffc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-321575187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4294d44f-8311-4103-9a8f-a94b3811986f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda4f5ee41d2439e935ee0f658f465d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d38225a3-d5bd-4912-b343-1aaa2a5437bb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:49:05Z,use_quota=True,user_id='95bf99de7a594e209f995e62db441850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:05.376165 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e106f4e-4e7f-468d-aaae-45621c347975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:05.380406 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e106f4e-4e7f-468d-aaae-45621c347975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:05.385592 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f973f9c0-ca54-44c7-bd95-a898288b38cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:05.390348 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f973f9c0-ca54-44c7-bd95-a898288b38cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4294d44f-8311-4103-9a8f-a94b3811986f', 'volume_name': 'volume-4294d44f-8311-4103-9a8f-a94b3811986f', 'volume_size': 1, 'snapshot_id': 'd38225a3-d5bd-4912-b343-1aaa2a5437bb'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:05.395310 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32ffb48-142a-49e4-9962-0ad2bd78c279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:05.399210 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32ffb48-142a-49e4-9962-0ad2bd78c279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:05.403964 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d86fa3b-c326-4c27-84de-93e8fc469a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:05.405766 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Volume 4294d44f-8311-4103-9a8f-a94b3811986f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4294d44f-8311-4103-9a8f-a94b3811986f', 'volume_size': 1, 'snapshot_id': 'd38225a3-d5bd-4912-b343-1aaa2a5437bb'}
Apr 16 21:49:05.423381 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] cloning volumes/volume-3058e8d0-fbda-4d13-9d0a-c92547a50d0a@snapshot-d38225a3-d5bd-4912-b343-1aaa2a5437bb to volume-4294d44f-8311-4103-9a8f-a94b3811986f {{(pid=130674) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}}
Apr 16 21:49:05.424180 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:05.474916 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:05.647961 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:49:05.667632 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Flow 'volume_create_manager' (a033d1af-224a-4865-9976-ffd9b1806c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:49:05.674684 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b3fadc-c72f-4ce0-b3d6-56d55f749482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:05.691513 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b3fadc-c72f-4ce0-b3d6-56d55f749482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-8528981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9dae930a-7641-45ad-8513-3b87b1c7cecc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1c4a83e6ef848c4bcff3c997bedecd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:49:05Z,use_quota=True,user_id='7bf6b6d1defa4c89a6eec189ac0dd358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:05.697336 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eeca868-7013-4648-82e6-e21602cf1ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:05.702248 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eeca868-7013-4648-82e6-e21602cf1ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:05.707444 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057ad856-30e3-4b4a-bd46-ef9248b8d72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:05.711548 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057ad856-30e3-4b4a-bd46-ef9248b8d72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dae930a-7641-45ad-8513-3b87b1c7cecc', 'volume_name': 'volume-9dae930a-7641-45ad-8513-3b87b1c7cecc', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:05.716535 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc4c989-a78b-4d25-a3c5-54360bd4b542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:05.720488 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc4c989-a78b-4d25-a3c5-54360bd4b542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:05.726296 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4356134-541f-4033-9a9f-8cb5854541cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:05.726659 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Volume 9dae930a-7641-45ad-8513-3b87b1c7cecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dae930a-7641-45ad-8513-3b87b1c7cecc', 'volume_size': 1}
Apr 16 21:49:05.726765 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] creating volume 'volume-9dae930a-7641-45ad-8513-3b87b1c7cecc' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:49:05.727406 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:06.736347 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:49:06.736927 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:49:06.743283 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4356134-541f-4033-9a9f-8cb5854541cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dae930a-7641-45ad-8513-3b87b1c7cecc', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:06.745450 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dfb9412-18a1-4d9c-a00d-60f2220c48a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:06.818225 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Volume volume-9dae930a-7641-45ad-8513-3b87b1c7cecc (9dae930a-7641-45ad-8513-3b87b1c7cecc): created successfully
Apr 16 21:49:06.821930 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dfb9412-18a1-4d9c-a00d-60f2220c48a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:06.828200 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Flow 'volume_create_manager' (a033d1af-224a-4865-9976-ffd9b1806c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:49:06.882798 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cedfad1a-3c0b-4b2a-8b19-36a68cd7e38d tempest-VolumesListTestJSON-335088165 None] Created volume successfully.
Apr 16 21:49:07.010911 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:49:07.011291 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:49:07.032869 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d86fa3b-c326-4c27-84de-93e8fc469a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4294d44f-8311-4103-9a8f-a94b3811986f', 'volume_size': 1, 'snapshot_id': 'd38225a3-d5bd-4912-b343-1aaa2a5437bb'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:07.037581 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a430e922-620a-488e-bd0f-be7f250e7eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:07.104073 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Volume volume-4294d44f-8311-4103-9a8f-a94b3811986f (4294d44f-8311-4103-9a8f-a94b3811986f): created successfully
Apr 16 21:49:07.107843 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a430e922-620a-488e-bd0f-be7f250e7eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:07.113871 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Flow 'volume_create_manager' (64efffd2-6746-4d3c-bcd0-c08945b3cb4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:49:07.189515 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8dbd4887-c709-4090-bec5-4ec420ac5690 tempest-VolumesSnapshotTestJSON-2078807312 None] Created volume successfully.
Apr 16 21:49:07.464962 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d3568b06-95cb-4c47-bfc9-cdf1178f2800 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-4294d44f-8311-4103-9a8f-a94b3811986f-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:49:07.557981 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d3568b06-95cb-4c47-bfc9-cdf1178f2800 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:07.715068 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d3568b06-95cb-4c47-bfc9-cdf1178f2800 tempest-VolumesSnapshotTestJSON-2078807312 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:49:07.813529 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d3568b06-95cb-4c47-bfc9-cdf1178f2800 tempest-VolumesSnapshotTestJSON-2078807312 None] deleting rbd volume volume-4294d44f-8311-4103-9a8f-a94b3811986f {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:49:08.145330 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:49:08.165279 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Flow 'volume_create_manager' (ae7d9c56-bf3d-4d58-a1ff-fbdeef01162a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:49:08.172461 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349565ef-7d2f-4c2c-96c1-a1b24b22b7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:08.187477 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349565ef-7d2f-4c2c-96c1-a1b24b22b7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-791855853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfcde168250f4d16b2d305afed23fee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:49:08Z,use_quota=True,user_id='9771814136c84ab3a13bc98dfd79a40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:08.192958 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea4190f-1491-4b9a-9b82-6d1765c76640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:08.197135 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea4190f-1491-4b9a-9b82-6d1765c76640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:08.202550 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82596c8c-ec2e-4e43-aad3-ca3736c4b28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:08.287464 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82596c8c-ec2e-4e43-aad3-ca3736c4b28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b', 'volume_name': 'volume-c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc712ebda90>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:08.292598 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309ec22f-6f0a-4429-9af1-bac8977745b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:08.297259 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309ec22f-6f0a-4429-9af1-bac8977745b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:08.302032 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bbe1e6-3c1c-4bb3-aed4-c4d92c0780c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:08.303160 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Volume c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc712ebda90>}
Apr 16 21:49:08.303728 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Cloning c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b from image 88bbe9a7-19d2-4102-9634-058b7c590848  at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 16 21:49:08.313921 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:49:08.412442 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 49, 8, 317990)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:49:08.412961 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:49:08.413464 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Found cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 16 21:49:08.417881 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" released by "_prepare_image_cache_entry" :: held 0.104s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:49:08.418864 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Attempting to retrieve cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 16 21:49:08.424817 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 21, 49, 8, 422562)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 21:49:08.425299 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 21:49:08.425791 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Creating from source image-volume e0e222dd-75a5-4728-81e0-d352ad2a6247 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 16 21:49:08.437588 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:08.629830 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] creating snapshot='volume-c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 21:49:11.109859 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] cloning 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247@volume-c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b.clone_snap' to 'volume-c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 21:49:11.125879 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b9113154-39ca-41d4-b939-77545e70d344 tempest-VolumesListTestJSON-335088165 None] Lock "b'cinder-9dae930a-7641-45ad-8513-3b87b1c7cecc-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:49:11.223549 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9113154-39ca-41d4-b939-77545e70d344 tempest-VolumesListTestJSON-335088165 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:11.434742 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9113154-39ca-41d4-b939-77545e70d344 tempest-VolumesListTestJSON-335088165 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:49:11.435158 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9113154-39ca-41d4-b939-77545e70d344 tempest-VolumesListTestJSON-335088165 None] Volume volume-9dae930a-7641-45ad-8513-3b87b1c7cecc is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:49:11.646971 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9113154-39ca-41d4-b939-77545e70d344 tempest-VolumesListTestJSON-335088165 None] deleting rbd volume volume-9dae930a-7641-45ad-8513-3b87b1c7cecc {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:49:11.995418 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-d3568b06-95cb-4c47-bfc9-cdf1178f2800 tempest-VolumesSnapshotTestJSON-2078807312 None] Created reservations ['04fa604d-e372-4f93-a49e-75b7a13d52b0', 'f26a68e6-5a4e-4766-889a-81085dc9cd14', '910aea5f-c17e-4556-978a-6851a614dc95', 'c1a3a19d-25e5-41e3-829b-171f7d491c12'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:49:12.161188 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d3568b06-95cb-4c47-bfc9-cdf1178f2800 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:12.182522 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d3568b06-95cb-4c47-bfc9-cdf1178f2800 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:12.205507 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d3568b06-95cb-4c47-bfc9-cdf1178f2800 tempest-VolumesSnapshotTestJSON-2078807312 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:49:12.209709 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d3568b06-95cb-4c47-bfc9-cdf1178f2800 tempest-VolumesSnapshotTestJSON-2078807312 None] Deleted volume successfully.
Apr 16 21:49:12.273034 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d3568b06-95cb-4c47-bfc9-cdf1178f2800 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-4294d44f-8311-4103-9a8f-a94b3811986f-delete_volume'" released by "delete_volume" :: held 4.808s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:49:12.805316 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:49:12.806894 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:49:12.807276 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:49:13.307114 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 21:49:13.307749 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Marking volume c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 21:49:13.329844 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ab2fd064-1b37-4535-8dfc-9939b1dabeb1 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-d38225a3-d5bd-4912-b343-1aaa2a5437bb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:49:13.331575 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ab2fd064-1b37-4535-8dfc-9939b1dabeb1 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:13.551386 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Copying metadata from image 88bbe9a7-19d2-4102-9634-058b7c590848 to c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 16 21:49:13.551739 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Creating volume glance metadata for volume c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b backed by image 88bbe9a7-19d2-4102-9634-058b7c590848 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 16 21:49:13.667443 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bbe1e6-3c1c-4bb3-aed4-c4d92c0780c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc712ebda90>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:13.673148 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff8726e-3b5d-4609-9924-abd841c4b146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:13.743709 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Volume volume-c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b (c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b): created successfully
Apr 16 21:49:13.747503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff8726e-3b5d-4609-9924-abd841c4b146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:13.753907 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Flow 'volume_create_manager' (ae7d9c56-bf3d-4d58-a1ff-fbdeef01162a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:49:13.829194 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0da7fb25-dc81-4654-b015-f0acea5223e0 tempest-TestVolumeBootPattern-410552364 None] Created volume successfully.
Apr 16 21:49:16.229735 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-ab2fd064-1b37-4535-8dfc-9939b1dabeb1 tempest-VolumesSnapshotTestJSON-2078807312 None] Created reservations ['0dafb965-eadf-4db1-9a17-168602806c4a', 'b3befec5-3b85-4846-9b6d-aab5b88ef0e9', '9a5f8483-3670-4aa1-947f-bfcc3159a021', '258e0319-4988-42d7-aacb-3eb8c412e06a'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:49:16.421156 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ab2fd064-1b37-4535-8dfc-9939b1dabeb1 tempest-VolumesSnapshotTestJSON-2078807312 None] Delete snapshot completed successfully.
Apr 16 21:49:16.428504 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ab2fd064-1b37-4535-8dfc-9939b1dabeb1 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-d38225a3-d5bd-4912-b343-1aaa2a5437bb-delete_snapshot'" released by "delete_snapshot" :: held 3.098s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:49:16.475324 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-b9113154-39ca-41d4-b939-77545e70d344 tempest-VolumesListTestJSON-335088165 None] Created reservations ['a155ba87-3aaa-4dc1-b591-9e917310fec7', 'd4d8901f-1ab0-4620-a954-021ed17f7acf', 'fed7ea68-22fa-4ed5-a26d-58ea2c596e8f', '8a07bf34-ff8e-400e-b67b-5df83b53f3a1'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:49:16.612834 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9113154-39ca-41d4-b939-77545e70d344 tempest-VolumesListTestJSON-335088165 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:16.634975 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b9113154-39ca-41d4-b939-77545e70d344 tempest-VolumesListTestJSON-335088165 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:16.658121 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-b9113154-39ca-41d4-b939-77545e70d344 tempest-VolumesListTestJSON-335088165 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:49:16.662098 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b9113154-39ca-41d4-b939-77545e70d344 tempest-VolumesListTestJSON-335088165 None] Deleted volume successfully.
Apr 16 21:49:16.741633 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b9113154-39ca-41d4-b939-77545e70d344 tempest-VolumesListTestJSON-335088165 None] Lock "b'cinder-9dae930a-7641-45ad-8513-3b87b1c7cecc-delete_volume'" released by "delete_volume" :: held 5.616s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:49:17.247958 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ff373eea-2292-452d-b547-ea1ecbe6e0af tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-3058e8d0-fbda-4d13-9d0a-c92547a50d0a-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:49:17.357585 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ff373eea-2292-452d-b547-ea1ecbe6e0af tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:17.520700 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ff373eea-2292-452d-b547-ea1ecbe6e0af tempest-VolumesSnapshotTestJSON-2078807312 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:49:17.521210 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ff373eea-2292-452d-b547-ea1ecbe6e0af tempest-VolumesSnapshotTestJSON-2078807312 None] Volume volume-3058e8d0-fbda-4d13-9d0a-c92547a50d0a is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:49:17.607032 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ff373eea-2292-452d-b547-ea1ecbe6e0af tempest-VolumesSnapshotTestJSON-2078807312 None] deleting rbd volume volume-3058e8d0-fbda-4d13-9d0a-c92547a50d0a {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:49:17.629769 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-8ef7089f-a202-4b6f-8933-5401830363b7 req-15f71a20-2083-4580-ac8c-276844423509 tempest-TestVolumeBootPattern-410552364 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:49:17.753259 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9a9e312c-805c-49c3-8a36-a5ad259aabaa tempest-VolumesListTestJSON-335088165 None] Lock "b'cinder-5003f8cf-c5ed-419e-ad74-e9afea0abf5c-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:49:17.821225 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9a9e312c-805c-49c3-8a36-a5ad259aabaa tempest-VolumesListTestJSON-335088165 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:17.989502 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9a9e312c-805c-49c3-8a36-a5ad259aabaa tempest-VolumesListTestJSON-335088165 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:49:17.990241 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9a9e312c-805c-49c3-8a36-a5ad259aabaa tempest-VolumesListTestJSON-335088165 None] Volume volume-5003f8cf-c5ed-419e-ad74-e9afea0abf5c is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:49:18.202215 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9a9e312c-805c-49c3-8a36-a5ad259aabaa tempest-VolumesListTestJSON-335088165 None] deleting rbd volume volume-5003f8cf-c5ed-419e-ad74-e9afea0abf5c {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:49:18.273529 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-8ef7089f-a202-4b6f-8933-5401830363b7 req-15f71a20-2083-4580-ac8c-276844423509 tempest-TestVolumeBootPattern-410552364 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.644s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:49:18.274233 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-8ef7089f-a202-4b6f-8933-5401830363b7 req-15f71a20-2083-4580-ac8c-276844423509 tempest-TestVolumeBootPattern-410552364 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:49:18.349472 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-8ef7089f-a202-4b6f-8933-5401830363b7 req-15f71a20-2083-4580-ac8c-276844423509 tempest-TestVolumeBootPattern-410552364 None] Connection info returned from driver {'name': 'volumes/volume-c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '75e38fc5-f421-42c7-9d6c-b28384dfcf14'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:49:18.428618 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-8ef7089f-a202-4b6f-8933-5401830363b7 req-15f71a20-2083-4580-ac8c-276844423509 tempest-TestVolumeBootPattern-410552364 None] attachment_update completed successfully.
Apr 16 21:49:22.492003 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-ff373eea-2292-452d-b547-ea1ecbe6e0af tempest-VolumesSnapshotTestJSON-2078807312 None] Created reservations ['ad46aeb5-c87b-4b77-ad61-8ced5f712b98', '1648968c-63f7-4464-871f-dfda5acdf9fa', '46101a96-7624-448b-9303-f3c2bc5dd1f2', 'ddb3a8f1-d79b-4e06-8e5d-2f1e276b49f3'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:49:22.687493 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ff373eea-2292-452d-b547-ea1ecbe6e0af tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:22.717889 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ff373eea-2292-452d-b547-ea1ecbe6e0af tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:22.740907 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-ff373eea-2292-452d-b547-ea1ecbe6e0af tempest-VolumesSnapshotTestJSON-2078807312 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:49:22.744979 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ff373eea-2292-452d-b547-ea1ecbe6e0af tempest-VolumesSnapshotTestJSON-2078807312 None] Deleted volume successfully.
Apr 16 21:49:22.827453 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ff373eea-2292-452d-b547-ea1ecbe6e0af tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-3058e8d0-fbda-4d13-9d0a-c92547a50d0a-delete_volume'" released by "delete_volume" :: held 5.580s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:49:23.240403 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-9a9e312c-805c-49c3-8a36-a5ad259aabaa tempest-VolumesListTestJSON-335088165 None] Created reservations ['43cb6d97-62d2-4b4c-ae04-8512ba1778eb', '563d098e-e09e-4a62-9851-1b1caa3bcfac', 'd53f74e8-7abf-461c-a209-5e65177bbcdb', '41f22949-cea3-4e87-ad96-3ffab424a56d'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:49:23.418258 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9a9e312c-805c-49c3-8a36-a5ad259aabaa tempest-VolumesListTestJSON-335088165 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:23.441829 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9a9e312c-805c-49c3-8a36-a5ad259aabaa tempest-VolumesListTestJSON-335088165 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:23.475842 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-9a9e312c-805c-49c3-8a36-a5ad259aabaa tempest-VolumesListTestJSON-335088165 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:49:23.480944 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9a9e312c-805c-49c3-8a36-a5ad259aabaa tempest-VolumesListTestJSON-335088165 None] Deleted volume successfully.
Apr 16 21:49:23.583413 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9a9e312c-805c-49c3-8a36-a5ad259aabaa tempest-VolumesListTestJSON-335088165 None] Lock "b'cinder-5003f8cf-c5ed-419e-ad74-e9afea0abf5c-delete_volume'" released by "delete_volume" :: held 5.830s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:49:23.755282 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3f86cad7-c1cd-46af-8c35-8aab68dc0d09 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-76be6301-032b-4101-9700-2929e6625298-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:49:23.756953 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3f86cad7-c1cd-46af-8c35-8aab68dc0d09 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:24.297440 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-e4278a91-8094-4192-84b5-419a2f6463e1 tempest-VolumesListTestJSON-335088165 None] Lock "b'cinder-6622d347-5a64-4343-95b5-e2d44b5ffd02-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:49:24.383952 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e4278a91-8094-4192-84b5-419a2f6463e1 tempest-VolumesListTestJSON-335088165 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:24.537197 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e4278a91-8094-4192-84b5-419a2f6463e1 tempest-VolumesListTestJSON-335088165 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:49:24.537669 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e4278a91-8094-4192-84b5-419a2f6463e1 tempest-VolumesListTestJSON-335088165 None] Volume volume-6622d347-5a64-4343-95b5-e2d44b5ffd02 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:49:24.720223 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e4278a91-8094-4192-84b5-419a2f6463e1 tempest-VolumesListTestJSON-335088165 None] deleting rbd volume volume-6622d347-5a64-4343-95b5-e2d44b5ffd02 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:49:25.909154 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-3f86cad7-c1cd-46af-8c35-8aab68dc0d09 tempest-VolumesSnapshotTestJSON-2078807312 None] Created reservations ['bf581de7-9db6-4407-8794-c663797d78bb', '75e9e4cc-3999-4523-b62b-6921e3563e43', '545db825-2be4-4ef1-8043-4ef342c39b85', '84bfbe74-c5bb-4547-8259-5ab0506c6ccf'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:49:26.092568 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3f86cad7-c1cd-46af-8c35-8aab68dc0d09 tempest-VolumesSnapshotTestJSON-2078807312 None] Delete snapshot completed successfully.
Apr 16 21:49:26.096999 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3f86cad7-c1cd-46af-8c35-8aab68dc0d09 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-76be6301-032b-4101-9700-2929e6625298-delete_snapshot'" released by "delete_snapshot" :: held 2.342s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:49:27.124648 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-7d1bc0ed-35d7-405c-a52d-6847fbfd1cec tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-fc253b4e-34fa-49aa-beb6-7a46c380c294-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:49:27.264287 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7d1bc0ed-35d7-405c-a52d-6847fbfd1cec tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:27.503267 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7d1bc0ed-35d7-405c-a52d-6847fbfd1cec tempest-VolumesSnapshotTestJSON-2078807312 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:49:27.503692 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7d1bc0ed-35d7-405c-a52d-6847fbfd1cec tempest-VolumesSnapshotTestJSON-2078807312 None] Volume volume-fc253b4e-34fa-49aa-beb6-7a46c380c294 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:49:27.732125 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7d1bc0ed-35d7-405c-a52d-6847fbfd1cec tempest-VolumesSnapshotTestJSON-2078807312 None] deleting rbd volume volume-fc253b4e-34fa-49aa-beb6-7a46c380c294 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:49:28.935232 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:49:28.937161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:28.960261 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:28.987320 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:49:28.990856 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-e4278a91-8094-4192-84b5-419a2f6463e1 tempest-VolumesListTestJSON-335088165 None] Created reservations ['1aac81ac-e59b-4917-8b54-47355084b6a3', '43fd2736-a2a4-4552-a32d-0448dd68c4fb', '85969d9e-ca5c-48e6-8e63-7752712f93d7', '352db82f-b910-4843-97da-31e8bc6d7b0b'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:49:29.137735 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e4278a91-8094-4192-84b5-419a2f6463e1 tempest-VolumesListTestJSON-335088165 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:29.166629 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e4278a91-8094-4192-84b5-419a2f6463e1 tempest-VolumesListTestJSON-335088165 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:29.192390 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-e4278a91-8094-4192-84b5-419a2f6463e1 tempest-VolumesListTestJSON-335088165 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:49:29.196900 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e4278a91-8094-4192-84b5-419a2f6463e1 tempest-VolumesListTestJSON-335088165 None] Deleted volume successfully.
Apr 16 21:49:29.279359 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-e4278a91-8094-4192-84b5-419a2f6463e1 tempest-VolumesListTestJSON-335088165 None] Lock "b'cinder-6622d347-5a64-4343-95b5-e2d44b5ffd02-delete_volume'" released by "delete_volume" :: held 4.982s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:49:31.311944 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-7d1bc0ed-35d7-405c-a52d-6847fbfd1cec tempest-VolumesSnapshotTestJSON-2078807312 None] Created reservations ['f5be0cfe-7430-4dbc-b6ed-c1da4536abf2', 'ce6d466f-72cf-4901-adc7-d0b807e52f1b', 'be66a610-b501-4459-a9a4-31a437755437', '58b7b3d5-0a2c-40a0-8676-26f1115fd2e7'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:49:31.498971 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7d1bc0ed-35d7-405c-a52d-6847fbfd1cec tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:31.545645 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7d1bc0ed-35d7-405c-a52d-6847fbfd1cec tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:31.602075 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-7d1bc0ed-35d7-405c-a52d-6847fbfd1cec tempest-VolumesSnapshotTestJSON-2078807312 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:49:31.616985 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7d1bc0ed-35d7-405c-a52d-6847fbfd1cec tempest-VolumesSnapshotTestJSON-2078807312 None] Deleted volume successfully.
Apr 16 21:49:31.690695 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-7d1bc0ed-35d7-405c-a52d-6847fbfd1cec tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-fc253b4e-34fa-49aa-beb6-7a46c380c294-delete_volume'" released by "delete_volume" :: held 4.566s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:49:32.861175 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-7f8409ce-f831-432c-89c1-c9ffe4a0fe70 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-fedcef50-29c9-4c19-a9b4-b678f9441c3f-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:49:33.006065 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7f8409ce-f831-432c-89c1-c9ffe4a0fe70 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:33.148261 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7f8409ce-f831-432c-89c1-c9ffe4a0fe70 tempest-VolumesSnapshotTestJSON-2078807312 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:49:33.201092 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7f8409ce-f831-432c-89c1-c9ffe4a0fe70 tempest-VolumesSnapshotTestJSON-2078807312 None] deleting rbd volume volume-fedcef50-29c9-4c19-a9b4-b678f9441c3f {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:49:33.204822 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:49:33.223939 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Flow 'volume_create_manager' (aed86a67-86b3-4120-aca3-4cd7c1d6466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:49:33.230740 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033d36f4-3152-44eb-b620-a802ac9d062f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:33.246217 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033d36f4-3152-44eb-b620-a802ac9d062f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1919287401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=69e80b8a-b6eb-4262-8595-31fe67c84f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38bff867bc664384abe17db534f10d6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:49:33Z,use_quota=True,user_id='dd4608bc9f1c41fe8e06bff91b7639ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:33.252262 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f176d6a-c8fa-48c0-a442-253191622a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:33.256352 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f176d6a-c8fa-48c0-a442-253191622a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:33.261478 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0104c364-3f50-44e8-80a1-b16e7399952c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:33.265586 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0104c364-3f50-44e8-80a1-b16e7399952c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e80b8a-b6eb-4262-8595-31fe67c84f23', 'volume_name': 'volume-69e80b8a-b6eb-4262-8595-31fe67c84f23', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:33.270479 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5a6cb7-eecd-4b07-8c36-538613125d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:33.274379 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5a6cb7-eecd-4b07-8c36-538613125d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:33.279114 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdca07f-144e-40b7-8191-376d1b610f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:33.280202 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Volume 69e80b8a-b6eb-4262-8595-31fe67c84f23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e80b8a-b6eb-4262-8595-31fe67c84f23', 'volume_size': 1}
Apr 16 21:49:33.289030 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] creating volume 'volume-69e80b8a-b6eb-4262-8595-31fe67c84f23' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:49:33.289030 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:34.158055 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:49:34.158614 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:49:34.162429 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdca07f-144e-40b7-8191-376d1b610f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e80b8a-b6eb-4262-8595-31fe67c84f23', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:34.167171 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b5e876-48d1-4b73-9c4d-bf6300f7a5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:49:34.228333 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Volume volume-69e80b8a-b6eb-4262-8595-31fe67c84f23 (69e80b8a-b6eb-4262-8595-31fe67c84f23): created successfully
Apr 16 21:49:34.231969 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b5e876-48d1-4b73-9c4d-bf6300f7a5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:49:34.237877 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Flow 'volume_create_manager' (aed86a67-86b3-4120-aca3-4cd7c1d6466a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:49:34.308227 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-92a6aef8-d3e4-4ac4-af93-f2930d59e781 tempest-VolumesSnapshotListTestJSON-1257650686 None] Created volume successfully.
Apr 16 21:49:35.193940 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cdf6f4c7-8ec1-4b25-8f0e-13bfa327e27e tempest-VolumesSnapshotListTestJSON-1257650686 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:37.149417 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7f8409ce-f831-432c-89c1-c9ffe4a0fe70 tempest-VolumesSnapshotTestJSON-2078807312 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:49:37.441054 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7f8409ce-f831-432c-89c1-c9ffe4a0fe70 tempest-VolumesSnapshotTestJSON-2078807312 None] deleting parent snapshot volume-fedcef50-29c9-4c19-a9b4-b678f9441c3f.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:49:39.679945 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-7f8409ce-f831-432c-89c1-c9ffe4a0fe70 tempest-VolumesSnapshotTestJSON-2078807312 None] Created reservations ['6ad8ec09-294e-4873-b6e5-01b053add120', 'e4844aa3-c83b-43f6-b8b3-5c8a406a4aa8', '7069b8b8-c174-44a5-85e8-e2e0737df5de', 'a09bc2e8-edce-4a78-ac6e-297e3c9bb857'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:49:39.897518 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7f8409ce-f831-432c-89c1-c9ffe4a0fe70 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:39.918681 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7f8409ce-f831-432c-89c1-c9ffe4a0fe70 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:39.941840 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-7f8409ce-f831-432c-89c1-c9ffe4a0fe70 tempest-VolumesSnapshotTestJSON-2078807312 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:49:39.945735 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7f8409ce-f831-432c-89c1-c9ffe4a0fe70 tempest-VolumesSnapshotTestJSON-2078807312 None] Deleted volume successfully.
Apr 16 21:49:40.014964 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-7f8409ce-f831-432c-89c1-c9ffe4a0fe70 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-fedcef50-29c9-4c19-a9b4-b678f9441c3f-delete_volume'" released by "delete_volume" :: held 7.154s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:49:40.120008 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cdf6f4c7-8ec1-4b25-8f0e-13bfa327e27e tempest-VolumesSnapshotListTestJSON-1257650686 None] Create snapshot completed successfully
Apr 16 21:49:40.330958 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-06b0cd7f-dcbb-4371-8d93-c90f07d14806 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-4201fdce-fcae-4c9c-856b-2507c4ae1a5c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:49:40.332459 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-06b0cd7f-dcbb-4371-8d93-c90f07d14806 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:40.720398 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0120d6c7-0931-4871-bf6e-70aefb454a96 tempest-VolumesSnapshotListTestJSON-1257650686 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:42.542991 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0120d6c7-0931-4871-bf6e-70aefb454a96 tempest-VolumesSnapshotListTestJSON-1257650686 None] Create snapshot completed successfully
Apr 16 21:49:43.239493 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4e78f966-fc80-420a-a6a7-cdbc9fac4e9b tempest-VolumesSnapshotListTestJSON-1257650686 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:43.868747 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-06b0cd7f-dcbb-4371-8d93-c90f07d14806 tempest-VolumesSnapshotTestJSON-2078807312 None] Created reservations ['f89ee299-04dd-46f1-8402-7a699ff976ba', '11a6b569-8ea5-48c8-b33e-045ca5ec2de3', '363a4da3-a0f4-4080-84c4-6ca1211fb3be', '84c58355-7aca-4e5d-a250-0b1ccb21f774'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:49:44.023485 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-06b0cd7f-dcbb-4371-8d93-c90f07d14806 tempest-VolumesSnapshotTestJSON-2078807312 None] Delete snapshot completed successfully.
Apr 16 21:49:44.026999 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-06b0cd7f-dcbb-4371-8d93-c90f07d14806 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-4201fdce-fcae-4c9c-856b-2507c4ae1a5c-delete_snapshot'" released by "delete_snapshot" :: held 3.696s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:49:44.637365 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-bcdcc08d-b2a3-4b86-83fa-68c74b414767 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-b419c8ec-d8d6-495e-9cec-3da461c92db9-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:49:44.771979 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bcdcc08d-b2a3-4b86-83fa-68c74b414767 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:44.936617 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bcdcc08d-b2a3-4b86-83fa-68c74b414767 tempest-VolumesSnapshotTestJSON-2078807312 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:49:44.937246 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bcdcc08d-b2a3-4b86-83fa-68c74b414767 tempest-VolumesSnapshotTestJSON-2078807312 None] Volume volume-b419c8ec-d8d6-495e-9cec-3da461c92db9 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:49:45.022900 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bcdcc08d-b2a3-4b86-83fa-68c74b414767 tempest-VolumesSnapshotTestJSON-2078807312 None] deleting rbd volume volume-b419c8ec-d8d6-495e-9cec-3da461c92db9 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:49:45.616844 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4e78f966-fc80-420a-a6a7-cdbc9fac4e9b tempest-VolumesSnapshotListTestJSON-1257650686 None] Create snapshot completed successfully
Apr 16 21:49:46.897723 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-6504f13f-7476-4a88-a99a-cec673ef76e8 tempest-VolumesSnapshotListTestJSON-1257650686 None] Lock "b'cinder-79666c08-e5e2-43f1-92e6-6b63383e5ce8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:49:46.899247 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6504f13f-7476-4a88-a99a-cec673ef76e8 tempest-VolumesSnapshotListTestJSON-1257650686 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:50.023389 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-bcdcc08d-b2a3-4b86-83fa-68c74b414767 tempest-VolumesSnapshotTestJSON-2078807312 None] Created reservations ['17979def-7107-4e28-bf0a-8153989e6044', '5de10115-3ab2-4d64-a4c1-9f03ea01e41c', 'd973a766-0337-4864-9f12-a14ca4866e86', '5f28f766-c4b4-48df-bf05-6e852716a46d'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:49:50.183253 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bcdcc08d-b2a3-4b86-83fa-68c74b414767 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:50.225852 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bcdcc08d-b2a3-4b86-83fa-68c74b414767 tempest-VolumesSnapshotTestJSON-2078807312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:50.249089 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-bcdcc08d-b2a3-4b86-83fa-68c74b414767 tempest-VolumesSnapshotTestJSON-2078807312 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:49:50.254114 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-bcdcc08d-b2a3-4b86-83fa-68c74b414767 tempest-VolumesSnapshotTestJSON-2078807312 None] Deleted volume successfully.
Apr 16 21:49:50.341274 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-bcdcc08d-b2a3-4b86-83fa-68c74b414767 tempest-VolumesSnapshotTestJSON-2078807312 None] Lock "b'cinder-b419c8ec-d8d6-495e-9cec-3da461c92db9-delete_volume'" released by "delete_volume" :: held 5.704s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:49:51.691568 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-6504f13f-7476-4a88-a99a-cec673ef76e8 tempest-VolumesSnapshotListTestJSON-1257650686 None] Created reservations ['390f7c6b-c089-4729-a7e3-a60fd75ab2db', 'b9553294-59f3-4e65-bd3d-a6a0860ac313', 'e6ca7675-a8c6-4edd-85c1-babec7a1a64d', '358178d5-1e3b-4b06-a60e-0adca08029a2'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:49:51.908379 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6504f13f-7476-4a88-a99a-cec673ef76e8 tempest-VolumesSnapshotListTestJSON-1257650686 None] Delete snapshot completed successfully.
Apr 16 21:49:51.912827 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-6504f13f-7476-4a88-a99a-cec673ef76e8 tempest-VolumesSnapshotListTestJSON-1257650686 None] Lock "b'cinder-79666c08-e5e2-43f1-92e6-6b63383e5ce8-delete_snapshot'" released by "delete_snapshot" :: held 5.015s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:49:52.161198 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a2c2401f-4492-4748-933e-a33cd65b98af tempest-VolumesSnapshotListTestJSON-1257650686 None] Lock "b'cinder-30057d5f-10d3-4add-b7d8-2a8d90beb6fb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:49:52.163729 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a2c2401f-4492-4748-933e-a33cd65b98af tempest-VolumesSnapshotListTestJSON-1257650686 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:55.879938 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-a2c2401f-4492-4748-933e-a33cd65b98af tempest-VolumesSnapshotListTestJSON-1257650686 None] Created reservations ['e5118977-dc98-4797-934d-087efb4a3037', '1e2b027d-1894-4853-81cc-99b20e65e32e', '5cec2b3a-db42-4cfe-9427-9d9e8fcfb2b0', '6e7b0de9-2181-4b1c-86bc-1798a380165b'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:49:56.068471 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a2c2401f-4492-4748-933e-a33cd65b98af tempest-VolumesSnapshotListTestJSON-1257650686 None] Delete snapshot completed successfully.
Apr 16 21:49:56.074111 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a2c2401f-4492-4748-933e-a33cd65b98af tempest-VolumesSnapshotListTestJSON-1257650686 None] Lock "b'cinder-30057d5f-10d3-4add-b7d8-2a8d90beb6fb-delete_snapshot'" released by "delete_snapshot" :: held 3.913s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:49:56.392136 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f771b68e-c6c4-4099-a96d-d8da5f053da8 tempest-VolumesSnapshotListTestJSON-1257650686 None] Lock "b'cinder-0906a626-4571-4f04-9531-948711b11b29-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:49:56.394058 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f771b68e-c6c4-4099-a96d-d8da5f053da8 tempest-VolumesSnapshotListTestJSON-1257650686 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:49:59.548748 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-f771b68e-c6c4-4099-a96d-d8da5f053da8 tempest-VolumesSnapshotListTestJSON-1257650686 None] Created reservations ['3b1cc2ec-dc83-44b2-a2eb-abef75746388', 'dd254482-8ba0-4328-bbbc-58106303dfe3', '53990147-7199-432e-b5cc-76706b55b47b', '041885cb-3a27-49b4-bef2-00562be60090'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:49:59.713660 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f771b68e-c6c4-4099-a96d-d8da5f053da8 tempest-VolumesSnapshotListTestJSON-1257650686 None] Delete snapshot completed successfully.
Apr 16 21:49:59.718184 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f771b68e-c6c4-4099-a96d-d8da5f053da8 tempest-VolumesSnapshotListTestJSON-1257650686 None] Lock "b'cinder-0906a626-4571-4f04-9531-948711b11b29-delete_snapshot'" released by "delete_snapshot" :: held 3.326s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:50:00.700827 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-66be0c88-287e-4516-80da-17cf2887f73a tempest-VolumesSnapshotListTestJSON-1257650686 None] Lock "b'cinder-69e80b8a-b6eb-4262-8595-31fe67c84f23-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:50:00.788605 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66be0c88-287e-4516-80da-17cf2887f73a tempest-VolumesSnapshotListTestJSON-1257650686 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:50:01.102553 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66be0c88-287e-4516-80da-17cf2887f73a tempest-VolumesSnapshotListTestJSON-1257650686 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:50:01.102996 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66be0c88-287e-4516-80da-17cf2887f73a tempest-VolumesSnapshotListTestJSON-1257650686 None] Volume volume-69e80b8a-b6eb-4262-8595-31fe67c84f23 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 21:50:01.313965 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66be0c88-287e-4516-80da-17cf2887f73a tempest-VolumesSnapshotListTestJSON-1257650686 None] deleting rbd volume volume-69e80b8a-b6eb-4262-8595-31fe67c84f23 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:50:06.496730 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-66be0c88-287e-4516-80da-17cf2887f73a tempest-VolumesSnapshotListTestJSON-1257650686 None] Created reservations ['6a62ffa6-5b72-4133-bf0e-bd7af8a717b9', '576c7ed9-5de9-4fee-8ed4-70833215b531', '44acecaa-0568-4067-a2d9-a4c8f9634b4e', '97e57021-841d-41df-af0b-59040d966820'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:50:06.828651 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66be0c88-287e-4516-80da-17cf2887f73a tempest-VolumesSnapshotListTestJSON-1257650686 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:50:06.912376 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-66be0c88-287e-4516-80da-17cf2887f73a tempest-VolumesSnapshotListTestJSON-1257650686 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:50:06.937713 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-66be0c88-287e-4516-80da-17cf2887f73a tempest-VolumesSnapshotListTestJSON-1257650686 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:50:06.941613 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-66be0c88-287e-4516-80da-17cf2887f73a tempest-VolumesSnapshotListTestJSON-1257650686 None] Deleted volume successfully.
Apr 16 21:50:06.986059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-66be0c88-287e-4516-80da-17cf2887f73a tempest-VolumesSnapshotListTestJSON-1257650686 None] Lock "b'cinder-69e80b8a-b6eb-4262-8595-31fe67c84f23-delete_volume'" released by "delete_volume" :: held 6.285s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:50:28.935935 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:50:28.936760 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:50:28.990280 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:50:29.012113 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:51:28.937119 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:51:28.937777 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:51:28.959260 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:51:28.981318 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:52:28.936984 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:52:28.938172 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:52:29.000905 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:52:29.022890 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:52:57.643507 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-a34a238c-af76-4c62-97f4-656beb2e7edf req-2f052e9d-9c5e-4be4-bfee-5ff955e9fdb7 tempest-TestVolumeBootPattern-410552364 None] Terminate volume connection completed successfully.
Apr 16 21:52:57.644228 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-a34a238c-af76-4c62-97f4-656beb2e7edf req-2f052e9d-9c5e-4be4-bfee-5ff955e9fdb7 tempest-TestVolumeBootPattern-410552364 None] Deleting attachment 75e38fc5-f421-42c7-9d6c-b28384dfcf14. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 21:52:59.354057 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-143b7fa2-dcbf-4971-ad08-bc3ab34817e3 tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 21:52:59.442167 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-143b7fa2-dcbf-4971-ad08-bc3ab34817e3 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:52:59.601180 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-143b7fa2-dcbf-4971-ad08-bc3ab34817e3 tempest-TestVolumeBootPattern-410552364 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 21:52:59.676988 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-143b7fa2-dcbf-4971-ad08-bc3ab34817e3 tempest-TestVolumeBootPattern-410552364 None] deleting rbd volume volume-c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 21:53:03.184629 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-143b7fa2-dcbf-4971-ad08-bc3ab34817e3 tempest-TestVolumeBootPattern-410552364 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 21:53:03.282247 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-143b7fa2-dcbf-4971-ad08-bc3ab34817e3 tempest-TestVolumeBootPattern-410552364 None] deleting parent snapshot volume-c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 21:53:05.880913 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-143b7fa2-dcbf-4971-ad08-bc3ab34817e3 tempest-TestVolumeBootPattern-410552364 None] Created reservations ['7d34fed2-34e5-4ae3-8985-13847643a306', 'a8f9ccc9-0184-42fd-9747-d5dba32213ff', '0227cced-20c5-41fd-a79b-ad56fac87678', '69aa45cf-45ad-45a4-9a4f-ff60d59e9826'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 21:53:06.041547 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-143b7fa2-dcbf-4971-ad08-bc3ab34817e3 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:53:06.064193 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-143b7fa2-dcbf-4971-ad08-bc3ab34817e3 tempest-TestVolumeBootPattern-410552364 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:53:06.085933 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-143b7fa2-dcbf-4971-ad08-bc3ab34817e3 tempest-TestVolumeBootPattern-410552364 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:53:06.090064 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-143b7fa2-dcbf-4971-ad08-bc3ab34817e3 tempest-TestVolumeBootPattern-410552364 None] Deleted volume successfully.
Apr 16 21:53:06.188157 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-143b7fa2-dcbf-4971-ad08-bc3ab34817e3 tempest-TestVolumeBootPattern-410552364 None] Lock "b'cinder-c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b-delete_volume'" released by "delete_volume" :: held 6.835s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 21:53:28.937976 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:53:28.938654 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:53:28.960413 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:53:28.982999 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:54:28.939129 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:54:28.939801 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:54:29.006799 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:54:29.028483 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:55:28.962680 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:55:28.962680 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:55:28.972511 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:55:28.994516 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:56:28.940498 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:56:28.941188 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:56:28.962717 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:56:28.987796 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:57:28.942705 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:57:28.943370 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:57:28.964505 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:57:28.986678 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:58:28.942141 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 21:58:28.942832 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:58:29.003552 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:58:29.025639 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 21:59:55.127541 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 21:59:55.148229 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Flow 'volume_create_manager' (e1d6b830-66cb-47a5-bf70-23bbc2dbe721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:59:55.154996 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7baae2-fea0-407b-b783-488f3305eec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:59:55.171634 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7baae2-fea0-407b-b783-488f3305eec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T21:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1149831293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=caecf11b-4959-4ab5-8a6a-95c2f5b310fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14958c4ca99847bfb86911005da65809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T21:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T21:59:55Z,use_quota=True,user_id='63b69490b00b49789e7859dca41f4a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:59:55.177838 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d26f5b-7fba-4a28-9721-563cdd133516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:59:55.182279 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d26f5b-7fba-4a28-9721-563cdd133516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:59:55.187685 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1ce60d-e5f5-4115-bfb0-d0e995059227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:59:55.192814 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1ce60d-e5f5-4115-bfb0-d0e995059227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caecf11b-4959-4ab5-8a6a-95c2f5b310fd', 'volume_name': 'volume-caecf11b-4959-4ab5-8a6a-95c2f5b310fd', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:59:55.197971 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca156c97-11c2-4b73-9771-95c0d2210c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:59:55.202054 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca156c97-11c2-4b73-9771-95c0d2210c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:59:55.207052 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ded0493-fa33-49b4-91a1-6ba9a0a58d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:59:55.208204 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Volume caecf11b-4959-4ab5-8a6a-95c2f5b310fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caecf11b-4959-4ab5-8a6a-95c2f5b310fd', 'volume_size': 1}
Apr 16 21:59:55.208611 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] creating volume 'volume-caecf11b-4959-4ab5-8a6a-95c2f5b310fd' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 21:59:55.209413 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 21:59:55.717507 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 21:59:55.717891 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 21:59:55.722756 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ded0493-fa33-49b4-91a1-6ba9a0a58d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caecf11b-4959-4ab5-8a6a-95c2f5b310fd', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:59:55.727339 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03296974-ae0b-4fc5-800a-ee41d9c5ebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 21:59:55.788953 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Volume volume-caecf11b-4959-4ab5-8a6a-95c2f5b310fd (caecf11b-4959-4ab5-8a6a-95c2f5b310fd): created successfully
Apr 16 21:59:55.792562 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03296974-ae0b-4fc5-800a-ee41d9c5ebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 21:59:55.798093 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Flow 'volume_create_manager' (e1d6b830-66cb-47a5-bf70-23bbc2dbe721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 21:59:55.862982 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-da8024c1-d15d-4abe-9ecd-5bd0644a5949 tempest-ServerActionsTestJSON-739373493 None] Created volume successfully.
Apr 16 21:59:56.931170 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-5ccf937f-ff64-4237-94c6-29f8893f2902 req-d770306f-5ef0-4895-a424-d39000b47397 tempest-ServerActionsTestJSON-739373493 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 21:59:57.555128 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-5ccf937f-ff64-4237-94c6-29f8893f2902 req-d770306f-5ef0-4895-a424-d39000b47397 tempest-ServerActionsTestJSON-739373493 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.624s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 21:59:57.555977 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-5ccf937f-ff64-4237-94c6-29f8893f2902 req-d770306f-5ef0-4895-a424-d39000b47397 tempest-ServerActionsTestJSON-739373493 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-caecf11b-4959-4ab5-8a6a-95c2f5b310fd', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'caecf11b-4959-4ab5-8a6a-95c2f5b310fd', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 21:59:57.639999 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-5ccf937f-ff64-4237-94c6-29f8893f2902 req-d770306f-5ef0-4895-a424-d39000b47397 tempest-ServerActionsTestJSON-739373493 None] Connection info returned from driver {'name': 'volumes/volume-caecf11b-4959-4ab5-8a6a-95c2f5b310fd', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'caecf11b-4959-4ab5-8a6a-95c2f5b310fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f4319b03-293a-42c5-9f5b-5f7224f2f5a3'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 21:59:57.761916 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-5ccf937f-ff64-4237-94c6-29f8893f2902 req-d770306f-5ef0-4895-a424-d39000b47397 tempest-ServerActionsTestJSON-739373493 None] attachment_update completed successfully.
Apr 16 22:00:20.691234 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-b5f7cec5-fe68-4765-99ba-60b77275c618 req-8a9c9de4-f0be-4c15-9a1c-b1fc61b98ce9 tempest-ServerActionsTestJSON-739373493 None] Terminate volume connection completed successfully.
Apr 16 22:00:20.691861 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-b5f7cec5-fe68-4765-99ba-60b77275c618 req-8a9c9de4-f0be-4c15-9a1c-b1fc61b98ce9 tempest-ServerActionsTestJSON-739373493 None] Deleting attachment f4319b03-293a-42c5-9f5b-5f7224f2f5a3. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 22:00:23.291926 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-b5f7cec5-fe68-4765-99ba-60b77275c618 req-f553a6a7-f541-4aa0-b7e3-65b3d7c0dc17 tempest-ServerActionsTestJSON-739373493 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 22:00:23.913397 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-b5f7cec5-fe68-4765-99ba-60b77275c618 req-f553a6a7-f541-4aa0-b7e3-65b3d7c0dc17 tempest-ServerActionsTestJSON-739373493 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.621s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 22:00:23.914260 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-b5f7cec5-fe68-4765-99ba-60b77275c618 req-f553a6a7-f541-4aa0-b7e3-65b3d7c0dc17 tempest-ServerActionsTestJSON-739373493 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-caecf11b-4959-4ab5-8a6a-95c2f5b310fd', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'caecf11b-4959-4ab5-8a6a-95c2f5b310fd', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 22:00:24.005702 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-b5f7cec5-fe68-4765-99ba-60b77275c618 req-f553a6a7-f541-4aa0-b7e3-65b3d7c0dc17 tempest-ServerActionsTestJSON-739373493 None] Connection info returned from driver {'name': 'volumes/volume-caecf11b-4959-4ab5-8a6a-95c2f5b310fd', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'caecf11b-4959-4ab5-8a6a-95c2f5b310fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3514e80d-0052-47c7-b3b7-2c4b3fdc5030'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 22:00:24.128414 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-b5f7cec5-fe68-4765-99ba-60b77275c618 req-f553a6a7-f541-4aa0-b7e3-65b3d7c0dc17 tempest-ServerActionsTestJSON-739373493 None] attachment_update completed successfully.
Apr 16 22:00:28.943636 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:00:28.944657 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:00:29.062931 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:00:29.107800 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:00:31.843618 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-da69e934-74cb-4101-986e-14c82425ade4 req-241475c1-9a64-45af-9bf6-9b1d64088259 tempest-ServerActionsTestJSON-739373493 None] Terminate volume connection completed successfully.
Apr 16 22:00:31.844540 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-da69e934-74cb-4101-986e-14c82425ade4 req-241475c1-9a64-45af-9bf6-9b1d64088259 tempest-ServerActionsTestJSON-739373493 None] Deleting attachment 3514e80d-0052-47c7-b3b7-2c4b3fdc5030. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 22:00:35.133170 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-da69e934-74cb-4101-986e-14c82425ade4 req-00d53617-0df5-4611-ade4-ac7d060b039e tempest-ServerActionsTestJSON-739373493 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 22:00:35.825313 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-da69e934-74cb-4101-986e-14c82425ade4 req-00d53617-0df5-4611-ade4-ac7d060b039e tempest-ServerActionsTestJSON-739373493 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.692s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 22:00:35.826107 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-da69e934-74cb-4101-986e-14c82425ade4 req-00d53617-0df5-4611-ade4-ac7d060b039e tempest-ServerActionsTestJSON-739373493 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-caecf11b-4959-4ab5-8a6a-95c2f5b310fd', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'caecf11b-4959-4ab5-8a6a-95c2f5b310fd', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 22:00:35.922073 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-da69e934-74cb-4101-986e-14c82425ade4 req-00d53617-0df5-4611-ade4-ac7d060b039e tempest-ServerActionsTestJSON-739373493 None] Connection info returned from driver {'name': 'volumes/volume-caecf11b-4959-4ab5-8a6a-95c2f5b310fd', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'caecf11b-4959-4ab5-8a6a-95c2f5b310fd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0043ea26-0305-4998-88b5-14ca2202a476'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 22:00:36.014922 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-da69e934-74cb-4101-986e-14c82425ade4 req-00d53617-0df5-4611-ade4-ac7d060b039e tempest-ServerActionsTestJSON-739373493 None] attachment_update completed successfully.
Apr 16 22:00:44.765113 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-30c90c43-1190-4962-98f1-a898cdf6284d req-ab91f6f4-54ba-40d0-aaba-89d3b9f1f717 tempest-ServerActionsTestJSON-739373493 None] Terminate volume connection completed successfully.
Apr 16 22:00:44.765839 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-30c90c43-1190-4962-98f1-a898cdf6284d req-ab91f6f4-54ba-40d0-aaba-89d3b9f1f717 tempest-ServerActionsTestJSON-739373493 None] Deleting attachment 0043ea26-0305-4998-88b5-14ca2202a476. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 22:00:45.742891 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-61b6bece-8002-462b-b22f-f71c9f3be6b2 tempest-ServerActionsTestJSON-739373493 None] Lock "b'cinder-caecf11b-4959-4ab5-8a6a-95c2f5b310fd-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 22:00:45.846002 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-61b6bece-8002-462b-b22f-f71c9f3be6b2 tempest-ServerActionsTestJSON-739373493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:00:45.987926 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-61b6bece-8002-462b-b22f-f71c9f3be6b2 tempest-ServerActionsTestJSON-739373493 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 22:00:45.988308 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-61b6bece-8002-462b-b22f-f71c9f3be6b2 tempest-ServerActionsTestJSON-739373493 None] Volume volume-caecf11b-4959-4ab5-8a6a-95c2f5b310fd is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 22:00:46.070559 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-61b6bece-8002-462b-b22f-f71c9f3be6b2 tempest-ServerActionsTestJSON-739373493 None] deleting rbd volume volume-caecf11b-4959-4ab5-8a6a-95c2f5b310fd {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 22:00:48.938640 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-61b6bece-8002-462b-b22f-f71c9f3be6b2 tempest-ServerActionsTestJSON-739373493 None] Created reservations ['13b97fb2-931f-4e39-a1e9-7584947be5e5', '718be112-144e-4e21-bd1f-7cb8ef49098c', '3fefca4e-2f5e-4456-98cf-4dc7083f4832', 'dd3967ab-c24b-4bee-b068-ad77a6a11dcf'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 22:00:49.098824 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-61b6bece-8002-462b-b22f-f71c9f3be6b2 tempest-ServerActionsTestJSON-739373493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:00:49.164502 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-61b6bece-8002-462b-b22f-f71c9f3be6b2 tempest-ServerActionsTestJSON-739373493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:00:49.186700 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-61b6bece-8002-462b-b22f-f71c9f3be6b2 tempest-ServerActionsTestJSON-739373493 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:00:49.191003 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-61b6bece-8002-462b-b22f-f71c9f3be6b2 tempest-ServerActionsTestJSON-739373493 None] Deleted volume successfully.
Apr 16 22:00:49.294843 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-61b6bece-8002-462b-b22f-f71c9f3be6b2 tempest-ServerActionsTestJSON-739373493 None] Lock "b'cinder-caecf11b-4959-4ab5-8a6a-95c2f5b310fd-delete_volume'" released by "delete_volume" :: held 3.552s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 22:01:28.943468 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:01:28.944119 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:01:28.995148 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:01:29.027416 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:02:28.942443 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:02:28.943181 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:02:28.980858 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:02:29.015413 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:02:42.394796 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 22:02:42.414843 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Flow 'volume_create_manager' (8fe13135-c867-4dee-8d03-617802d83f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 22:02:42.422403 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac43b35-bd59-4136-8a79-457a89f004f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 22:02:42.437809 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac43b35-bd59-4136-8a79-457a89f004f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T22:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2074964006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151ed48abb644e47bbf210bbca563e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T22:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T22:02:42Z,use_quota=True,user_id='c683afdee06e4958bc94e991dd18257b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 22:02:42.443195 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc39568-0cd7-4dc8-b13f-1ea6e582d805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 22:02:42.447403 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc39568-0cd7-4dc8-b13f-1ea6e582d805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 22:02:42.452629 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce72bdca-8d3c-4368-9315-d808b4de4575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 22:02:42.456748 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce72bdca-8d3c-4368-9315-d808b4de4575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28', 'volume_name': 'volume-ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 22:02:42.461648 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6165f7-5466-434b-beee-714efe537e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 22:02:42.465638 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6165f7-5466-434b-beee-714efe537e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 22:02:42.470723 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9081e8e0-8ce7-4f4d-8012-81cbc87d4e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 22:02:42.471785 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Volume ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28', 'volume_size': 1}
Apr 16 22:02:42.472206 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] creating volume 'volume-ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 16 22:02:42.472983 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:02:43.036396 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 22:02:43.036780 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 22:02:43.040609 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9081e8e0-8ce7-4f4d-8012-81cbc87d4e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 22:02:43.045407 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c94803d-9122-459e-ace9-66fd3e59ec77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 22:02:43.136354 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Volume volume-ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28 (ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28): created successfully
Apr 16 22:02:43.140037 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c94803d-9122-459e-ace9-66fd3e59ec77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 22:02:43.145773 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Flow 'volume_create_manager' (8fe13135-c867-4dee-8d03-617802d83f65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 22:02:43.239437 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-812d258f-e59e-49b4-9f56-415d6025368c tempest-TestMinimumBasicScenario-191090217 None] Created volume successfully.
Apr 16 22:02:44.223392 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-f4249f40-3678-4ae1-993e-f430d340f551 req-b95cc51c-2c08-4960-920d-f7f30aea41e2 tempest-TestMinimumBasicScenario-191090217 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 22:02:44.867585 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-f4249f40-3678-4ae1-993e-f430d340f551 req-b95cc51c-2c08-4960-920d-f7f30aea41e2 tempest-TestMinimumBasicScenario-191090217 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.644s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 22:02:44.868452 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-f4249f40-3678-4ae1-993e-f430d340f551 req-b95cc51c-2c08-4960-920d-f7f30aea41e2 tempest-TestMinimumBasicScenario-191090217 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': 'ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 22:02:44.946802 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-f4249f40-3678-4ae1-993e-f430d340f551 req-b95cc51c-2c08-4960-920d-f7f30aea41e2 tempest-TestMinimumBasicScenario-191090217 None] Connection info returned from driver {'name': 'volumes/volume-ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bcd80b7d-dfa4-4442-94b1-eb6c04ac8109'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 22:02:45.053472 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-f4249f40-3678-4ae1-993e-f430d340f551 req-b95cc51c-2c08-4960-920d-f7f30aea41e2 tempest-TestMinimumBasicScenario-191090217 None] attachment_update completed successfully.
Apr 16 22:03:28.940047 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:03:28.940995 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:03:28.964323 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:03:28.986429 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:04:07.106828 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-c482d477-9342-48f9-8680-e909fdc67ad2 req-1530af52-3f65-47c0-ad24-ffa0e006e803 tempest-TestMinimumBasicScenario-191090217 None] Terminate volume connection completed successfully.
Apr 16 22:04:07.107570 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-c482d477-9342-48f9-8680-e909fdc67ad2 req-1530af52-3f65-47c0-ad24-ffa0e006e803 tempest-TestMinimumBasicScenario-191090217 None] Deleting attachment bcd80b7d-dfa4-4442-94b1-eb6c04ac8109. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 22:04:07.767685 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-7fb4522c-678c-4510-a48c-c36868924c97 tempest-TestMinimumBasicScenario-191090217 None] Lock "b'cinder-ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 22:04:07.860377 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7fb4522c-678c-4510-a48c-c36868924c97 tempest-TestMinimumBasicScenario-191090217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:04:08.008950 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7fb4522c-678c-4510-a48c-c36868924c97 tempest-TestMinimumBasicScenario-191090217 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 22:04:08.009332 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7fb4522c-678c-4510-a48c-c36868924c97 tempest-TestMinimumBasicScenario-191090217 None] Volume volume-ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 22:04:08.123640 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7fb4522c-678c-4510-a48c-c36868924c97 tempest-TestMinimumBasicScenario-191090217 None] deleting rbd volume volume-ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 22:04:11.175172 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-7fb4522c-678c-4510-a48c-c36868924c97 tempest-TestMinimumBasicScenario-191090217 None] Created reservations ['d2279763-528d-448f-97d1-50bdff67d8c7', '1ce58fb3-8439-4a5b-8514-98565965c4e1', '03d0dc77-a46b-4924-9d3d-a642219a774d', '77b0ffb5-fb79-4901-ae8c-c8f7f5de7518'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 22:04:11.341325 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7fb4522c-678c-4510-a48c-c36868924c97 tempest-TestMinimumBasicScenario-191090217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:04:11.364604 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7fb4522c-678c-4510-a48c-c36868924c97 tempest-TestMinimumBasicScenario-191090217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:04:11.387142 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-7fb4522c-678c-4510-a48c-c36868924c97 tempest-TestMinimumBasicScenario-191090217 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:04:11.391402 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7fb4522c-678c-4510-a48c-c36868924c97 tempest-TestMinimumBasicScenario-191090217 None] Deleted volume successfully.
Apr 16 22:04:11.447320 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-7fb4522c-678c-4510-a48c-c36868924c97 tempest-TestMinimumBasicScenario-191090217 None] Lock "b'cinder-ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28-delete_volume'" released by "delete_volume" :: held 3.680s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 22:04:28.943222 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:04:28.944145 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:04:28.968543 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:04:28.990801 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:05:28.946624 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:05:28.947301 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:05:28.968379 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:05:28.990807 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:06:28.946700 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:06:28.947302 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:06:28.968798 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:06:28.990346 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:07:28.945610 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:07:28.946208 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:07:28.991508 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:07:29.094283 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:08:28.944959 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:08:28.945612 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:08:28.967580 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:08:28.990577 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:09:28.945697 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:09:28.946292 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:09:28.967974 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:09:28.989488 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:10:28.945781 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:10:28.946408 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:10:28.968844 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:10:28.989728 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:11:28.945274 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:11:28.945954 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:11:28.967704 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:11:28.989415 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:12:28.944506 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:12:28.945218 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:12:28.970762 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:12:28.996336 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:13:28.944224 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:13:28.944834 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:13:28.966218 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:13:28.987686 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:14:28.944289 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:14:28.944975 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:14:28.966816 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:14:28.988294 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:15:28.944792 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:15:28.945417 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:15:28.968038 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:15:28.989772 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:16:28.945984 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:16:28.948319 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:16:28.989316 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:16:29.034008 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:17:28.949586 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:17:28.950199 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:17:28.972761 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:17:28.994135 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:18:28.949225 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:18:28.949840 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:18:29.008526 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:18:29.030752 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:18:49.051990 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 16 22:18:49.071883 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Flow 'volume_create_manager' (3a89e0ac-a87c-4609-b506-89fa50ffe2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 22:18:49.078470 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7914c981-8a15-4692-a91c-95bf881b9c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 22:18:49.095418 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7914c981-8a15-4692-a91c-95bf881b9c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-16T22:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1881616017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=716d5dcf-9ded-4bb8-b567-3f9363383a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a91917b203d4a2ca179d394e04af71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-16T22:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-16T22:18:49Z,use_quota=True,user_id='37ff1c2e4f3b45f589d675028674ecb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb02772d-e253-417b-8d1b-b3b9378a0c4c),volume_type_id=cb02772d-e253-417b-8d1b-b3b9378a0c4c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 22:18:49.100846 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (238cb7c4-f61d-4295-b9d9-2b54f50b02df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 22:18:49.105692 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (238cb7c4-f61d-4295-b9d9-2b54f50b02df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 22:18:49.110818 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e724d7d-c3e4-466d-8ed4-4376cda46a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 22:18:49.187343 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e724d7d-c3e4-466d-8ed4-4376cda46a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '716d5dcf-9ded-4bb8-b567-3f9363383a4c', 'volume_name': 'volume-716d5dcf-9ded-4bb8-b567-3f9363383a4c', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710af13d0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 22:18:49.192417 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d43cce5-217a-46e4-abaa-70aca302cf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 22:18:49.197135 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d43cce5-217a-46e4-abaa-70aca302cf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 22:18:49.201890 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694119c5-d8e8-4974-8010-28522f6bc875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 22:18:49.203010 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Volume 716d5dcf-9ded-4bb8-b567-3f9363383a4c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-716d5dcf-9ded-4bb8-b567-3f9363383a4c', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710af13d0>}
Apr 16 22:18:49.203575 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Cloning 716d5dcf-9ded-4bb8-b567-3f9363383a4c from image 88bbe9a7-19d2-4102-9634-058b7c590848  at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 16 22:18:49.237186 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 22:18:49.295935 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 22, 18, 49, 215543)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 22:18:49.296396 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 22:18:49.300899 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Found cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 16 22:18:49.300899 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Lock "b'cinder-88bbe9a7-19d2-4102-9634-058b7c590848'" released by "_prepare_image_cache_entry" :: held 0.090s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 22:18:49.301788 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Attempting to retrieve cache entry for image = 88bbe9a7-19d2-4102-9634-058b7c590848 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 16 22:18:49.307140 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Found image-volume cache entry: {'id': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'volume_id': 'e0e222dd-75a5-4728-81e0-d352ad2a6247', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59), 'last_used': datetime.datetime(2022, 4, 16, 22, 18, 49, 305023)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 16 22:18:49.307543 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Image-volume cache entry image_update_at = 2022-04-16 20:57:59+00:00, requested image updated_at = 2022-04-16 20:57:59+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 16 22:18:49.307929 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Creating from source image-volume e0e222dd-75a5-4728-81e0-d352ad2a6247 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 16 22:18:49.319171 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:18:49.484079 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] creating snapshot='volume-716d5dcf-9ded-4bb8-b567-3f9363383a4c.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 16 22:18:50.867171 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] cloning 'volume-e0e222dd-75a5-4728-81e0-d352ad2a6247@volume-716d5dcf-9ded-4bb8-b567-3f9363383a4c.clone_snap' to 'volume-716d5dcf-9ded-4bb8-b567-3f9363383a4c' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 16 22:18:51.720307 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Volume volume-548a92a5-efad-482f-97c9-7684e6c4b453.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 16 22:18:51.721435 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 16 22:18:51.721808 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 16 22:18:51.985835 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 16 22:18:51.986454 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Marking volume 716d5dcf-9ded-4bb8-b567-3f9363383a4c as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 16 22:18:52.038880 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Copying metadata from image 88bbe9a7-19d2-4102-9634-058b7c590848 to 716d5dcf-9ded-4bb8-b567-3f9363383a4c. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 16 22:18:52.039305 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Creating volume glance metadata for volume 716d5dcf-9ded-4bb8-b567-3f9363383a4c backed by image 88bbe9a7-19d2-4102-9634-058b7c590848 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 16 22:18:52.133811 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694119c5-d8e8-4974-8010-28522f6bc875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-716d5dcf-9ded-4bb8-b567-3f9363383a4c', 'volume_size': 1, 'image_id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e87c6370d064a9590394440a74344bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '88bbe9a7-19d2-4102-9634-058b7c590848', 'created_at': datetime.datetime(2022, 4, 16, 20, 57, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 16, 20, 57, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88bbe9a7-19d2-4102-9634-058b7c590848/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fc710af13d0>}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 22:18:52.138561 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b7097f-6bd1-42de-b896-addd820c3bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 16 22:18:52.192984 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Volume volume-716d5dcf-9ded-4bb8-b567-3f9363383a4c (716d5dcf-9ded-4bb8-b567-3f9363383a4c): created successfully
Apr 16 22:18:52.197371 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b7097f-6bd1-42de-b896-addd820c3bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 16 22:18:52.203070 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Flow 'volume_create_manager' (3a89e0ac-a87c-4609-b506-89fa50ffe2ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 16 22:18:52.250242 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cb6e2ddd-02c2-4589-aba3-b259e5dbc2b6 tempest-TestShelveInstance-414998748 None] Created volume successfully.
Apr 16 22:18:56.211015 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-34451519-dfa7-43b0-962e-b583d1f4abb7 req-c1d1d5f1-7595-4bc3-ab6b-5b1057ad80ae tempest-TestShelveInstance-414998748 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 16 22:18:56.896902 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-34451519-dfa7-43b0-962e-b583d1f4abb7 req-c1d1d5f1-7595-4bc3-ab6b-5b1057ad80ae tempest-TestShelveInstance-414998748 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.686s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 16 22:18:56.897667 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-34451519-dfa7-43b0-962e-b583d1f4abb7 req-c1d1d5f1-7595-4bc3-ab6b-5b1057ad80ae tempest-TestShelveInstance-414998748 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-716d5dcf-9ded-4bb8-b567-3f9363383a4c', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '10a8cab7-4487-40c7-abcb-c5cebe867304', 'volume_id': '716d5dcf-9ded-4bb8-b567-3f9363383a4c', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 16 22:18:56.976841 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-34451519-dfa7-43b0-962e-b583d1f4abb7 req-c1d1d5f1-7595-4bc3-ab6b-5b1057ad80ae tempest-TestShelveInstance-414998748 None] Connection info returned from driver {'name': 'volumes/volume-716d5dcf-9ded-4bb8-b567-3f9363383a4c', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '716d5dcf-9ded-4bb8-b567-3f9363383a4c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '07cd8141-e373-4070-8d4c-772ea7a4c9ea'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 16 22:18:57.096231 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-34451519-dfa7-43b0-962e-b583d1f4abb7 req-c1d1d5f1-7595-4bc3-ab6b-5b1057ad80ae tempest-TestShelveInstance-414998748 None] attachment_update completed successfully.
Apr 16 22:19:28.945988 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:19:28.947492 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:19:28.972727 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:19:28.995478 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:20:28.951212 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:20:28.951823 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:20:29.016746 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:20:29.040234 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:21:28.955964 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:21:28.956617 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:21:28.979171 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:21:29.001244 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:22:28.956542 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:22:28.957165 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:22:29.038810 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:22:29.061109 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:22:46.440710 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-223f9301-9a87-460b-b8d3-65b2c2d67539 req-294add8c-a5d9-41f2-b3bc-50aa57df3ce2 tempest-TestShelveInstance-414998748 None] Terminate volume connection completed successfully.
Apr 16 22:22:46.441317 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-223f9301-9a87-460b-b8d3-65b2c2d67539 req-294add8c-a5d9-41f2-b3bc-50aa57df3ce2 tempest-TestShelveInstance-414998748 None] Deleting attachment 07cd8141-e373-4070-8d4c-772ea7a4c9ea. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 16 22:22:46.763431 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-223f9301-9a87-460b-b8d3-65b2c2d67539 req-bd70e202-533c-47d5-adff-65b518fa7125 tempest-TestShelveInstance-414998748 None] Lock "b'cinder-716d5dcf-9ded-4bb8-b567-3f9363383a4c-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 16 22:22:46.876765 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-223f9301-9a87-460b-b8d3-65b2c2d67539 req-bd70e202-533c-47d5-adff-65b518fa7125 tempest-TestShelveInstance-414998748 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:22:47.028858 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-223f9301-9a87-460b-b8d3-65b2c2d67539 req-bd70e202-533c-47d5-adff-65b518fa7125 tempest-TestShelveInstance-414998748 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 16 22:22:47.167167 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-223f9301-9a87-460b-b8d3-65b2c2d67539 req-bd70e202-533c-47d5-adff-65b518fa7125 tempest-TestShelveInstance-414998748 None] deleting rbd volume volume-716d5dcf-9ded-4bb8-b567-3f9363383a4c {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 16 22:22:50.909882 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-223f9301-9a87-460b-b8d3-65b2c2d67539 req-bd70e202-533c-47d5-adff-65b518fa7125 tempest-TestShelveInstance-414998748 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 16 22:22:51.035030 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-223f9301-9a87-460b-b8d3-65b2c2d67539 req-bd70e202-533c-47d5-adff-65b518fa7125 tempest-TestShelveInstance-414998748 None] deleting parent snapshot volume-716d5dcf-9ded-4bb8-b567-3f9363383a4c.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 16 22:22:53.520331 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-223f9301-9a87-460b-b8d3-65b2c2d67539 req-bd70e202-533c-47d5-adff-65b518fa7125 tempest-TestShelveInstance-414998748 None] Created reservations ['40f06a63-3216-4885-9dba-b3dadd8f3a91', 'c5877a16-4ddd-4995-aa8a-601391039ac9', '3f6f46e9-5d3f-4b83-a6c7-c457bb16b31d', '910b4e72-a82e-409c-b39b-6eafa6918bbe'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 16 22:22:53.681883 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-223f9301-9a87-460b-b8d3-65b2c2d67539 req-bd70e202-533c-47d5-adff-65b518fa7125 tempest-TestShelveInstance-414998748 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:22:53.709963 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-223f9301-9a87-460b-b8d3-65b2c2d67539 req-bd70e202-533c-47d5-adff-65b518fa7125 tempest-TestShelveInstance-414998748 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:22:53.736515 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-223f9301-9a87-460b-b8d3-65b2c2d67539 req-bd70e202-533c-47d5-adff-65b518fa7125 tempest-TestShelveInstance-414998748 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:22:53.740800 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-223f9301-9a87-460b-b8d3-65b2c2d67539 req-bd70e202-533c-47d5-adff-65b518fa7125 tempest-TestShelveInstance-414998748 None] Deleted volume successfully.
Apr 16 22:22:53.803231 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-223f9301-9a87-460b-b8d3-65b2c2d67539 req-bd70e202-533c-47d5-adff-65b518fa7125 tempest-TestShelveInstance-414998748 None] Lock "b'cinder-716d5dcf-9ded-4bb8-b567-3f9363383a4c-delete_volume'" released by "delete_volume" :: held 7.040s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 16 22:23:28.957690 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:23:28.958344 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:23:28.986542 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:23:29.064942 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:24:28.960464 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:24:28.961082 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:24:28.982232 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:24:29.004097 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:25:28.958963 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:25:28.959627 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:25:28.991788 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:25:29.120503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:26:28.956492 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:26:28.957107 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:26:28.995121 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:26:29.017083 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:27:28.954120 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:27:28.954750 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:27:28.975857 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:27:28.997338 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:28:28.952955 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:28:28.953637 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:28:29.000641 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:28:29.035505 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:29:28.954129 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:29:28.954734 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:29:29.020280 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:29:29.047290 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:30:28.953224 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:30:28.953853 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:30:28.974996 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:30:28.995847 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:31:28.951518 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:31:28.952151 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:31:28.974581 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:31:28.995710 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:32:28.951320 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:32:28.952028 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:32:28.973016 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:32:28.994204 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:33:28.950789 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:33:28.951474 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:33:28.973567 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:33:28.996561 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:34:28.952455 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:34:28.953130 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:34:28.974120 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:34:28.995658 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:35:28.950683 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:35:28.951312 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:35:28.972369 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:35:28.993379 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 22:36:28.949049 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 16 22:36:28.949671 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:36:28.970831 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 16 22:36:28.992378 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8918aed5-3785-4e1b-99fd-af85697eaca6 None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}