-- Logs begin at Sat 2022-07-16 20:01:20 UTC, end at Sat 2022-07-16 22:44:58 UTC. --
Jul 16 20:58:14.998540 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service.
Jul 16 20:58:18.516961 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=131661) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}}
Jul 16 20:58:18.522292 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=131661) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 16 20:58:18.950901 ncdv-master-1 cinder-volume[131661]: INFO dbcounter [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] Registered counter for database cinder
Jul 16 20:58:18.970453 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_db.sqlalchemy.engines [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jul 16 20:58:18.977902 ncdv-master-1 cinder-volume[131661]: DEBUG dbcounter [-] [131661] Writer thread running {{(pid=131661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}}
Jul 16 20:58:19.187111 ncdv-master-1 cinder-volume[131661]: INFO cinder.rpc [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 16 20:58:19.193952 ncdv-master-1 cinder-volume[131661]: INFO cinder.rpc [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 16 20:58:19.202107 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_db.sqlalchemy.engines [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jul 16 20:58:19.370728 ncdv-master-1 cinder-volume[131661]: INFO cinder.volume.manager [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] Determined volume DB was empty at startup.
Jul 16 20:58:19.371384 ncdv-master-1 cinder-volume[131661]: DEBUG cinder.volume.manager [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=131661) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}}
Jul 16 20:58:19.380450 ncdv-master-1 cinder-volume[131661]: INFO cinder.volume.manager [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 16 20:58:19.381247 ncdv-master-1 cinder-volume[131661]: WARNING stevedore.named [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 16 20:58:19.381750 ncdv-master-1 cinder-volume[131661]: WARNING castellan.key_manager [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 16 20:58:19.382916 ncdv-master-1 cinder-volume[131661]: WARNING cinder.keymgr.conf_key_mgr [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 16 20:58:19.398823 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_db.sqlalchemy.engines [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jul 16 20:58:19.404711 ncdv-master-1 cinder-volume[131661]: INFO cinder.rpc [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 16 20:58:19.410009 ncdv-master-1 cinder-volume[131661]: INFO cinder.rpc [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version.
Jul 16 20:58:19.411962 ncdv-master-1 cinder-volume[131661]: WARNING stevedore.named [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 16 20:58:19.412709 ncdv-master-1 cinder-volume[131661]: WARNING castellan.key_manager [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 16 20:58:19.415254 ncdv-master-1 cinder-volume[131661]: INFO cinder.volume.manager [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] Image-volume cache enabled for host ncdv-master-1@ceph.
Jul 16 20:58:19.422559 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_db.sqlalchemy.engines [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jul 16 20:58:19.509974 ncdv-master-1 cinder-volume[131661]: INFO oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] Starting 1 workers
Jul 16 20:58:19.515800 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] Started child 131857 {{(pid=131661) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}}
Jul 16 20:58:19.517181 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] Full set of CONF: {{(pid=131661) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}}
Jul 16 20:58:19.517800 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ******************************************************************************** {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jul 16 20:58:19.518454 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] Configuration options gathered from: {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jul 16 20:58:19.518454 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jul 16 20:58:19.519204 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jul 16 20:58:19.523589 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ================================================================================ {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jul 16 20:58:19.523589 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] allow_availability_zone_fallback = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.523589 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] allow_compression_on_image_upload = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.523589 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] allowed_direct_url_schemes     = [] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.523589 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] api_rate_limit                 = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.523589 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] auth_strategy                  = keystone {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.524421 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] az_cache_duration              = 3600 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.524421 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_availability_zone      = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.524421 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_host                   = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.524421 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_name                   = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.524421 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_stats_polling_interval = 60 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.525037 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backup_api_class               = cinder.backup.api.API {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.525037 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.525384 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backup_name_template           = backup-%s {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.525789 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backup_use_same_host           = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.526172 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backup_use_temp_snapshot       = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.526556 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] chap_password                  = **** {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.526953 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] chap_username                  =  {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.531811 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.532552 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cinder_internal_tenant_project_id = c3045a89835d4e879a0ddc2557b831a3 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.533196 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cinder_internal_tenant_user_id = 6dcc74f579e447938a2477e253e5d36e {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.533841 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cloned_volume_same_az          = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.534038 ncdv-master-1 cinder-volume[131857]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0)
Jul 16 20:58:19.534553 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cluster                        = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.535168 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] compression_format             = gzip {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.536668 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] compute_api_class              = cinder.compute.nova.API {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.537934 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] config_dir                     = [] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.538688 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.539674 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] config_source                  = [] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.540582 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.541560 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] control_exchange               = openstack {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.542601 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] debug                          = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.543586 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] default_availability_zone      = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.544564 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] default_group_type             = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.545973 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.546926 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] default_volume_type            = ceph {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.548083 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] driver_client_cert             = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.549007 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] driver_client_cert_key         = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.549894 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] driver_data_namespace          = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.550843 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] driver_ssl_cert_path           = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.552235 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] driver_ssl_cert_verify         = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.553134 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] driver_use_ssl                 = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.554000 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] enable_force_upload            = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.554944 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] enable_new_services            = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.555828 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] enable_unsupported_driver      = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.556780 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] enabled_backends               = ['ceph'] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.557571 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] enforce_multipath_for_image_xfer = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.591590 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] filter_function                = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.591590 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] glance_api_insecure            = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.591590 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] glance_api_servers             = ['http://10.222.0.16/image'] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.591590 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] glance_api_ssl_compression     = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.591590 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] glance_ca_certificates_file    = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.591590 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] glance_catalog_info            = image:glance:publicURL {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.593137 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] glance_certfile                = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.593137 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.593137 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] glance_keyfile                 = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.593137 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] glance_num_retries             = 3 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.593137 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] glance_request_timeout         = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.593137 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] goodness_function              = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.593641 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] graceful_shutdown_timeout      = 5 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.593641 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] group_api_class                = cinder.group.api.API {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.593782 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] Starting volume driver RBDDriver (1.2.0)
Jul 16 20:58:19.593870 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] host                           = ncdv-master-1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.593870 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] iet_conf                       = /etc/iet/ietd.conf {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.593870 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] image_compress_on_upload       = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.593870 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] image_conversion_address_space_limit = 1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.594123 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 20:58:19.594201 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] image_conversion_cpu_limit     = 60 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.594201 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.594201 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] image_conversion_disable       = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.594201 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] image_upload_use_cinder_backend = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.594201 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] image_upload_use_internal_tenant = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.594201 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] image_volume_cache_enabled     = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.594201 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] image_volume_cache_max_count   = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.594638 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] image_volume_cache_max_size_gb = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.594638 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] init_host_max_objects_retrieval = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.594638 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] instance_format                = [instance: %(uuid)s]  {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.594638 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.594638 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] iscsi_iotype                   = fileio {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.594638 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] iscsi_secondary_ip_addresses   = [] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.594638 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] iscsi_target_flags             =  {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.595623 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] iscsi_write_cache              = on {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.595623 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] iser_helper                    = tgtadm {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.595623 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] iser_ip_address                = 10.222.0.16 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.595623 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] iser_port                      = 3260 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.595623 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.595623 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] log_config_append              = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.596376 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.596376 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] log_dir                        = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.596376 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] log_file                       = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.596376 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] log_options                    = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.596376 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] log_rotate_interval            = 1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.596376 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] log_rotate_interval_type       = days {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.596376 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] log_rotation_type              = none {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.597240 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.597240 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.597240 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.597240 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.597240 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.598417 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] max_age                        = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.598417 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] max_logfile_count              = 30 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.598417 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] max_logfile_size_mb            = 200 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.598417 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] max_over_subscription_ratio    = 20.0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.598417 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] message_reap_interval          = 86400 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.598417 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] message_ttl                    = 2592000 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.598417 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] migration_create_volume_timeout_secs = 300 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.599428 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] monkey_patch                   = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.599428 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] monkey_patch_modules           = [] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.599428 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] my_ip                          = 10.222.0.16 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.599428 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] no_snapshot_gb_quota           = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.599428 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] num_iser_scan_tries            = 3 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.599428 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] num_shell_tries                = 3 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.599428 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] num_volume_device_scan_tries   = 3 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.600267 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] nvmet_ns_id                    = 10 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.600267 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] nvmet_port_id                  = 1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.600267 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] osapi_max_limit                = 1000 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.600267 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] osapi_volume_ext_list          = [] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.600267 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.600267 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] osapi_volume_listen            = 0.0.0.0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.601014 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] osapi_volume_listen_port       = 8776 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.601014 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] osapi_volume_use_ssl           = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.601014 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] osapi_volume_workers           = 2 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.601014 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] per_volume_size_limit          = -1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.601014 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] periodic_fuzzy_delay           = 60 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.601014 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] periodic_interval              = 60 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.601014 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] project_id_regex               = [0-9a-f\-]+ {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.602060 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] public_endpoint                = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.602060 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] publish_errors                 = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.602060 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] quota_backup_gigabytes         = 1000 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.602060 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] quota_backups                  = 10 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.602060 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] quota_consistencygroups        = 10 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.602060 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.602060 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] quota_gigabytes                = 1000 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.602873 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] quota_groups                   = 10 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.602873 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] quota_snapshots                = 10 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.602873 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] quota_volumes                  = 10 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.602873 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] rate_limit_burst               = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.602873 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] rate_limit_except_level        = CRITICAL {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.602873 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] rate_limit_interval            = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.602873 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] reinit_driver_count            = 3 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.603754 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] replication_device             = **** {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.603754 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] report_discard_supported       = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.603754 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] report_interval                = 10 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.603754 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] reservation_clean_interval     = 86400 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.603754 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] reservation_expire             = 86400 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.603754 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] reserved_percentage            = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.603754 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.604722 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.605127 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] rpc_response_timeout           = 120 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.605686 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] run_external_periodic_tasks    = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.605903 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.606592 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] scst_target_driver             = iscsi {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.607122 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] scst_target_iqn_name           = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.607398 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] service_down_time              = 60 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.607770 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] snapshot_name_template         = snapshot-%s {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.608128 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] snapshot_same_host             = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.608497 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] split_loggers                  = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.608797 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] state_path                     = /opt/stack/data/cinder {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.609180 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] storage_availability_zone      = nova {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.609617 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] storage_protocol               = iSCSI {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.610006 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] syslog_log_facility            = LOG_USER {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.610377 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] target_helper                  = lioadm {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.610872 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] target_ip_address              = 10.222.0.16 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.611253 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] target_port                    = 3260 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.611749 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.612005 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] target_protocol                = iscsi {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.612358 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] trace_flags                    = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.612809 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] transfer_api_class             = cinder.transfer.api.API {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.615874 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] transport_url                  = **** {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.616344 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] until_refresh                  = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.616733 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] use_chap_auth                  = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.617118 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] use_default_quota_class        = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.617494 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] use_eventlog                   = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.617932 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] use_journal                    = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.618486 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] use_json                       = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.619045 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] use_multipath_for_image_xfer   = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.619575 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] use_stderr                     = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.620687 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] use_syslog                     = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.621443 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] verify_glance_signatures       = enabled {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.621974 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] volume_api_class               = cinder.volume.api.API {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.622481 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] volume_backend_name            = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.623001 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] volume_clear                   = zero {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.623532 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] volume_clear_ionice            = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.624381 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] volume_clear_size              = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.625587 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.626327 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] volume_copy_bps_limit          = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.626873 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] volume_dd_blocksize            = 1M {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.627336 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.627716 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] volume_name_template           = volume-%s {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.628081 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] volume_service_inithost_offload = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.628460 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] volume_usage_audit_period      = month {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.628914 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.629331 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] watch_log_file                 = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.629681 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] zoning_mode                    = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jul 16 20:58:19.631801 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.632773 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.633257 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_concurrency.disable_process_locking = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.633655 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.634097 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.634445 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.634822 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.635221 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.639705 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.639705 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.admin_password = **** {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.639705 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.639705 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.admin_token = **** {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.639705 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.admin_user  = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.639705 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.auth_admin_prefix =  {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.640473 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.640473 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.auth_port   = 35357 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.640473 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.auth_protocol = https {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.640473 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.auth_section = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.640473 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.auth_type   = password {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.640804 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 20:58:19.640887 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.auth_uri    = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.641174 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.auth_version = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.641356 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.cache       = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.641740 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.642093 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.certfile    = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.642498 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.delay_auth_decision = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.642903 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.643288 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.http_connect_timeout = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.643646 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.643995 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.identity_uri = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.644359 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.include_service_catalog = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.644779 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.insecure    = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.645260 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.interface   = public {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.645614 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.keyfile     = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.646103 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.646491 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.646853 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.647271 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.647631 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.648002 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.648393 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.648751 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.649231 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.649515 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.region_name = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.649892 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.650286 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.service_token_roles_required = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.650772 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.service_type = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.651312 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.token_cache_time = 300 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.651690 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] keystone_authtoken.www_authenticate_uri = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.652153 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.backend                  = dogpile.cache.null {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.652543 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.backend_argument         = **** {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.652922 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.config_prefix            = cache.oslo {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.653363 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.dead_timeout             = 60.0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.653727 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.debug_cache_backend      = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.654084 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.enable_retry_client      = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.654438 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.enable_socket_keepalive  = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.654790 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.enabled                  = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.655191 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.expiration_time          = 600 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.655553 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.hashclient_retry_attempts = 2 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.655937 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.hashclient_retry_delay   = 1.0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.656643 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.memcache_dead_retry      = 300 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.657477 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.658078 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.658445 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.memcache_pool_maxsize    = 10 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.658834 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.667694 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.667694 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.memcache_socket_timeout  = 1.0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.667694 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.proxies                  = [] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.667694 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.retry_attempts           = 2 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.667694 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.retry_delay              = 0.0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.667694 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.socket_keepalive_count   = 1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.667694 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.socket_keepalive_idle    = 1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.726344 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.socket_keepalive_interval = 1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.726344 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.tls_allowed_ciphers      = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.726344 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.tls_cafile               = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.726344 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.tls_certfile             = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.726344 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.tls_enabled              = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.726344 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cache.tls_keyfile              = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.726344 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] coordination.backend_url       = etcd3+http://10.222.0.16:2379 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.726805 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.backend               = sqlalchemy {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.726805 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.connection            = **** {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.726805 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.connection_debug      = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.726805 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.connection_parameters =  {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.726805 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.connection_recycle_time = 3600 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.726805 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.connection_trace      = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.726805 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.db_inc_retry_interval = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.727302 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.db_max_retries        = 20 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.727302 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.db_max_retry_interval = 10 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.727302 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.db_retry_interval     = 1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.727302 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.max_overflow          = 50 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.727302 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.max_pool_size         = 5 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.727302 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.max_retries           = 10 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.727302 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.mysql_enable_ndb      = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.727754 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.727754 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.pool_timeout          = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.727754 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.retry_interval        = 10 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.727754 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.slave_connection      = **** {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.727754 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.sqlite_synchronous    = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.727754 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] database.use_db_reconnect      = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.727754 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_policy.enforce_new_defaults = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.728200 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_policy.enforce_scope      = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.728200 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_policy.policy_default_rule = default {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.728200 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.728200 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_policy.policy_file        = policy.yaml {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.728200 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.728200 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.728578 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.728578 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.728578 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.728578 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] profiler.connection_string     = messaging:// {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.728578 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] profiler.enabled               = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.728578 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] profiler.es_doc_type           = notification {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.729689 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] profiler.es_scroll_size        = 10000 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.729689 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] profiler.es_scroll_time        = 2m {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.729689 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] profiler.filter_error_trace    = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.729689 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] profiler.hmac_keys             = SECRET_KEY {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.729689 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] profiler.sentinel_service_name = mymaster {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.729689 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] profiler.socket_timeout        = 0.1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.729689 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] profiler.trace_sqlalchemy      = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.731359 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] privsep_osbrick.capabilities   = [21] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.731359 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] privsep_osbrick.group          = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.731359 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] privsep_osbrick.helper_command = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.731359 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] privsep_osbrick.logger_name    = oslo_privsep.daemon {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.731359 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.731359 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] privsep_osbrick.user           = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.731359 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.731806 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cinder_sys_admin.group         = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.731806 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cinder_sys_admin.helper_command = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.731806 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.731806 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.731806 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] cinder_sys_admin.user          = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.731806 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] service_user.auth_section      = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.731806 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] service_user.auth_type         = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.732348 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] service_user.cafile            = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.732348 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] service_user.certfile          = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.732348 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] service_user.collect_timing    = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.732348 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] service_user.insecure          = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.732348 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] service_user.keyfile           = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.733427 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 20:58:19.733596 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] service_user.send_service_user_token = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.733596 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] service_user.split_loggers     = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.733596 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] service_user.timeout           = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.733596 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.backend_availability_zone = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.733596 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.733596 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.734405 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.chap_password = **** {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.734405 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.chap_username =  {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.734405 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.734405 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.734405 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.734405 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.driver_client_cert = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.735554 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.driver_client_cert_key = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.735554 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.driver_data_namespace = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.735554 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.735554 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.735554 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.driver_use_ssl = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.735554 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.enable_deferred_deletion = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.736303 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.enable_unsupported_driver = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.736303 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.736303 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.extra_capabilities = {} {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.736303 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.filter_function = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.736303 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.goodness_function = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.736303 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.iet_conf      = /etc/iet/ietd.conf {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.736923 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.736923 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.736923 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.736923 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.736923 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.736923 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.iscsi_iotype  = fileio {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.737535 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.737535 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.iscsi_target_flags =  {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.737535 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.iscsi_write_cache = on {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.737535 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.iser_helper   = tgtadm {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.737535 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.iser_ip_address = 10.222.0.16 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.737535 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.iser_port     = 3260 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.739868 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.739868 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.739868 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.739868 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.num_shell_tries = 3 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.739868 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.739868 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.740343 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.nvmet_port_id = 1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.740343 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.rados_connect_timeout = -1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.740343 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.rados_connection_interval = 5 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.740343 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.rados_connection_retries = 3 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.740343 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.rbd_ceph_conf =  {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.740343 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.rbd_cluster_name = ceph {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.740343 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.740984 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.740984 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.740984 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.rbd_pool      = rbd {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.740984 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.rbd_secret_uuid = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.740984 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.740984 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.rbd_user      = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.741445 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.replication_connect_timeout = 5 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.741445 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.replication_device = **** {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.741445 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.report_discard_supported = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.741445 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.741445 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.reserved_percentage = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.741445 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.scst_target_driver = iscsi {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.741851 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.scst_target_iqn_name = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.741851 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.storage_protocol = iSCSI {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.741851 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.741851 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.target_helper = tgtadm {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.741851 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.target_ip_address = 10.222.0.16 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.741851 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.target_port   = 3260 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.742446 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.742446 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.target_protocol = iscsi {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.742446 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.trace_flags   = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.742446 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.unique_fqdn_network = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.742446 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.use_chap_auth = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.742446 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.742870 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.volume_backend_name = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.742870 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.volume_clear  = zero {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.742870 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.volume_clear_ionice = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.742870 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.volume_clear_size = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.742870 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.742870 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.743393 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.743393 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.743393 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.743393 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_reports.file_event_handler = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.743393 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.743393 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_reports.log_dir           = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.743878 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.backend_availability_zone = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.743878 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.backend_host              = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.743878 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.backend_native_threads_pool_size = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.743878 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.backup_use_temp_snapshot  = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.743878 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.chap_password             = **** {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.743878 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.chap_username             = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.743878 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.chiscsi_conf              = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.744441 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.deferred_deletion_delay   = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.744441 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.deferred_deletion_purge_interval = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.744441 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.driver_client_cert        = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.744441 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.driver_client_cert_key    = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.744441 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.driver_data_namespace     = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.744441 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.driver_ssl_cert_path      = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.744441 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.driver_ssl_cert_verify    = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.744956 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.driver_use_ssl            = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.744956 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.enable_deferred_deletion  = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.744956 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.enable_unsupported_driver = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.744956 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.744956 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.extra_capabilities        = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.744956 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.filter_function           = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.744956 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.goodness_function         = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.745528 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.iet_conf                  = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.745528 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.image_upload_use_cinder_backend = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.745528 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.image_upload_use_internal_tenant = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.745528 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.image_volume_cache_enabled = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.745528 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.image_volume_cache_max_count = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.745528 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.image_volume_cache_max_size_gb = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.745528 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.iscsi_iotype              = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.746125 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.746125 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.iscsi_target_flags        = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.746125 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.iscsi_write_cache         = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.746125 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.iser_helper               = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.746125 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.iser_ip_address           = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.746125 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.iser_port                 = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.746125 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.iser_target_prefix        = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.746633 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.max_over_subscription_ratio = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.746633 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.num_iser_scan_tries       = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.746633 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.num_shell_tries           = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.746633 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.num_volume_device_scan_tries = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.746633 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.nvmet_ns_id               = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.746633 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.nvmet_port_id             = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.746633 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.rados_connect_timeout     = -1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.748872 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.rados_connection_interval = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.748872 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.rados_connection_retries  = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.748872 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.rbd_ceph_conf             = /etc/ceph/ceph.conf {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.748872 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.rbd_cluster_name          = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.748872 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.748872 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.748872 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.rbd_max_clone_depth       = 5 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.749472 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.rbd_pool                  = volumes {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.749472 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.rbd_secret_uuid           = 314f633c-a190-4b43-bf64-3306a55ebc3e {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.749472 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.rbd_store_chunk_size      = 4 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.749472 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.rbd_user                  = cinder {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.749472 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.replication_connect_timeout = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.749472 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.replication_device        = **** {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.749894 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.report_discard_supported  = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.749894 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.report_dynamic_total_capacity = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.749894 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.reserved_percentage       = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.749894 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.scst_target_driver        = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.749894 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.scst_target_iqn_name      = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.749894 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.storage_protocol          = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.749894 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.suppress_requests_ssl_warnings = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.750409 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.target_helper             = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.750409 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.target_ip_address         = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.750409 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.target_port               = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.750409 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.target_prefix             = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.750409 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.target_protocol           = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.750820 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.driver [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] Driver hasn't implemented _init_vendor_properties()
Jul 16 20:58:19.750923 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.trace_flags               = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.751423 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.driver [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:9fe12b71-14ff-4664-9b56-00a25cd04b5b:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=131857) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}}
Jul 16 20:58:19.751590 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.unique_fqdn_network       = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.751590 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.use_chap_auth             = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.751590 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.use_multipath_for_image_xfer = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.751590 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.volume_backend_name       = ceph {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.751590 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.volume_clear              = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.751590 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.volume_clear_ionice       = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.751590 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.volume_clear_size         = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.752141 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.752141 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.volume_copy_bps_limit     = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.752141 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.volume_dd_blocksize       = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.752141 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.volume_driver             = cinder.volume.drivers.rbd.RBDDriver {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.752141 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ceph.volumes_dir               = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.752141 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.752558 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.752558 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.752558 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.752558 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.752558 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.752558 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.753053 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.753053 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.753189 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.754436 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.754436 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.755552 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.755552 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.756040 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.759138 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.759346 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_db.sqlalchemy.engines [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jul 16 20:58:19.759519 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.760269 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.760652 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.761017 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.761382 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.761744 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writer thread running {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}}
Jul 16 20:58:19.761850 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.762310 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.762866 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.763080 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.763480 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.ssl      = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.763852 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.764234 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.764591 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.764967 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.765470 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_rabbit.ssl_version =  {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.765806 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_notifications.driver = [] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.766200 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_notifications.retry = -1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.766617 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.766977 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] oslo_messaging_notifications.transport_url = **** {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.767351 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.767651 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] key_manager.fixed_key          = **** {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.768084 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.768438 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican.barbican_api_version  = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.768808 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican.barbican_endpoint     = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.769196 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican.barbican_endpoint_type = public {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.769551 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican.barbican_region_name  = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.783590 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican.cafile                = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.784588 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican.certfile              = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.785235 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican.collect_timing        = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.786714 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican.insecure              = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.787515 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican.keyfile               = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.788000 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican.number_of_retries     = 60 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.788495 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican.retry_delay           = 1 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.789659 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican.send_service_user_token = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.790154 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican.split_loggers         = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.790641 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican.timeout               = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.791396 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican.verify_ssl            = True {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.791854 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican.verify_ssl_path       = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.792363 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican_service_user.auth_section = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.792814 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican_service_user.auth_type = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.793249 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican_service_user.cafile   = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.793663 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican_service_user.certfile = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.794083 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican_service_user.collect_timing = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.794543 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican_service_user.insecure = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.794978 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican_service_user.keyfile  = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.795436 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican_service_user.split_loggers = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.795847 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] barbican_service_user.timeout  = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.796300 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] vault.approle_role_id          = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.796710 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] vault.approle_secret_id        = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.797068 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] vault.cafile                   = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.797481 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] vault.certfile                 = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.797958 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] vault.collect_timing           = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.798381 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] vault.insecure                 = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.798738 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] vault.keyfile                  = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.799151 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] vault.kv_mountpoint            = secret {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.799892 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] vault.kv_version               = 2 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.800247 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] vault.namespace                = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.800600 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] vault.root_token_id            = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.801457 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] vault.split_loggers            = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.801880 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] vault.ssl_ca_crt_file          = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.802462 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] vault.timeout                  = None {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.802871 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] vault.use_ssl                  = False {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.803271 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jul 16 20:58:19.803562 ncdv-master-1 cinder-volume[131661]: DEBUG oslo_service.service [None req-65fcad1a-63b5-4c32-8abb-3d7388fc0c7d None None] ******************************************************************************** {{(pid=131661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jul 16 20:58:19.809063 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.db.sqlalchemy.api [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] Building query based on filter {{(pid=131857) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3887}}
Jul 16 20:58:19.830165 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.image_utils [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=131857) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:991}}
Jul 16 20:58:19.837315 ncdv-master-1 cinder-volume[131857]: INFO cinder.keymgr.migration [None req-e31d162a-17d6-40f9-9596-5cede829574d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 16 20:58:19.845644 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 20:58:19.900069 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 20:58:19.939663 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 20:58:19.970294 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] Driver initialization completed successfully.
Jul 16 20:58:19.970294 ncdv-master-1 cinder-volume[131857]: INFO cinder.manager [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] Initiating service 3 cleanup
Jul 16 20:58:19.979563 ncdv-master-1 cinder-volume[131857]: INFO cinder.manager [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] Service 3 cleanup completed.
Jul 16 20:58:19.979925 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.service [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] Creating RPC server for service cinder-volume {{(pid=131857) start /opt/stack/cinder/cinder/service.py:238}}
Jul 16 20:58:19.988140 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.service [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=131857) start /opt/stack/cinder/cinder/service.py:244}}
Jul 16 20:58:20.041584 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0)
Jul 16 20:58:20.042752 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 20:58:20.070836 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 20:58:20.176850 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-de11e5ce-5594-4201-8fae-4a105905b466 None None] Driver post RPC initialization completed successfully.
Jul 16 20:58:29.436066 ncdv-master-1 cinder-volume[131661]: DEBUG dbcounter [-] [131661] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=131661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 20:58:30.109030 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=24,cinder:INSERT=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 20:58:30.117998 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 20:58:50.205749 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 20:59:10.182190 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 20:59:20.176294 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 20:59:34.179091 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 20:59:34.179789 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 20:59:34.205048 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 20:59:34.228964 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 20:59:50.174304 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 20:59:50.175059 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:00:30.164704 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:00:34.175081 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:00:34.175745 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:00:34.214612 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:00:34.270510 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:00:40.170911 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:01:10.177891 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:01:20.185912 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:01:34.176163 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:01:34.176802 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:01:34.199248 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:01:34.223410 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:01:50.178242 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:02:00.175054 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:02:30.169089 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:02:34.179658 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:02:34.180333 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:02:34.206573 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:02:34.233966 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:02:40.168803 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:03:10.173586 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:03:20.165215 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:03:34.180739 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:03:34.181417 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:03:34.208747 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:03:34.239048 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:03:40.173305 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:04:00.171774 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:04:10.177667 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:04:20.176367 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:04:30.182280 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:04:34.185199 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:04:34.185847 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:04:34.207746 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:04:34.230488 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:05:00.188351 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:05:10.186462 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:05:34.186382 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:05:34.187100 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:05:34.208557 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:05:34.230737 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:05:40.187493 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:05:50.182201 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:06:20.185285 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:06:30.190190 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:06:34.186993 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:06:34.187789 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:06:34.209877 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:06:34.233433 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:07:00.185657 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:07:10.188820 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:07:34.188750 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:07:34.189377 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:07:34.213677 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:07:34.236323 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:07:40.187527 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:07:40.188135 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:08:10.190355 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:08:20.194979 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:08:34.192211 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:08:34.194018 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:08:34.307133 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:08:34.378132 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:08:40.190915 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:08:50.214117 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:09:10.208037 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:09:20.208285 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:09:34.197394 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:09:34.199669 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:09:34.289432 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:09:34.355284 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:09:40.196829 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:09:50.204362 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:10:20.199982 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:10:30.197636 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:10:34.193181 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:10:34.196648 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:10:34.273232 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:10:34.341136 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:10:40.210665 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:11:00.230690 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:11:20.219002 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:11:34.207728 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:11:34.208785 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:11:34.307553 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:11:34.394844 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:11:40.213371 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:12:00.212461 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:12:00.213104 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:12:14.290429 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:12:14.402638 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Flow 'volume_create_manager' (8d3016c6-417a-4fff-9302-bb4612a5c37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:12:14.416864 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca53057-950d-43a1-80cb-e8602a6a3a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:12:14.476110 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca53057-950d-43a1-80cb-e8602a6a3a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-1435418013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ce0ae7fc-6256-4387-a72f-dd24801e38f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b769bf8f3ea4e368bf68de1df6538f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:12:14Z,use_quota=True,user_id='6a69f9dee03d43beaafa966216b9e289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:12:14.481802 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b006b53-51ad-4acc-8278-0a179ee9aa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:12:14.486894 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b006b53-51ad-4acc-8278-0a179ee9aa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:12:14.492433 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87222961-b418-4019-8e46-3b14c4ef2a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:12:14.496086 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87222961-b418-4019-8e46-3b14c4ef2a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce0ae7fc-6256-4387-a72f-dd24801e38f0', 'volume_name': 'volume-ce0ae7fc-6256-4387-a72f-dd24801e38f0', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:12:14.500345 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db427516-7d9a-482c-aac1-368e08f54e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:12:14.503980 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db427516-7d9a-482c-aac1-368e08f54e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:12:14.508037 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b08e8a6-f3c9-41ed-b819-3f179686629d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:12:14.509238 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Volume ce0ae7fc-6256-4387-a72f-dd24801e38f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce0ae7fc-6256-4387-a72f-dd24801e38f0', 'volume_size': 1}
Jul 16 21:12:14.510355 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] creating volume 'volume-ce0ae7fc-6256-4387-a72f-dd24801e38f0' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:12:14.511573 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:12:15.410011 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:12:15.411489 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:12:15.415384 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b08e8a6-f3c9-41ed-b819-3f179686629d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce0ae7fc-6256-4387-a72f-dd24801e38f0', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:12:15.433677 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01de1f79-e45c-4d98-a379-0384f3cd0144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:12:15.571288 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Volume volume-ce0ae7fc-6256-4387-a72f-dd24801e38f0 (ce0ae7fc-6256-4387-a72f-dd24801e38f0): created successfully
Jul 16 21:12:15.584101 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01de1f79-e45c-4d98-a379-0384f3cd0144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:12:15.604658 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Flow 'volume_create_manager' (8d3016c6-417a-4fff-9302-bb4612a5c37e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:12:15.776912 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-141d19ff-28fd-4024-99cd-162085280638 tempest-LiveMigrationTest-1001758322 None] Created volume successfully.
Jul 16 21:12:18.588467 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-54d07af3-066e-466f-aa4d-b5c99beb2557 req-40eee31a-14dc-4047-823a-de2b36dd9906 tempest-LiveMigrationTest-1001758322 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:12:19.529060 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-54d07af3-066e-466f-aa4d-b5c99beb2557 req-40eee31a-14dc-4047-823a-de2b36dd9906 tempest-LiveMigrationTest-1001758322 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.941s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:12:19.531593 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-54d07af3-066e-466f-aa4d-b5c99beb2557 req-40eee31a-14dc-4047-823a-de2b36dd9906 tempest-LiveMigrationTest-1001758322 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ce0ae7fc-6256-4387-a72f-dd24801e38f0', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'ce0ae7fc-6256-4387-a72f-dd24801e38f0', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:12:19.691274 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-54d07af3-066e-466f-aa4d-b5c99beb2557 req-40eee31a-14dc-4047-823a-de2b36dd9906 tempest-LiveMigrationTest-1001758322 None] Connection info returned from driver {'name': 'volumes/volume-ce0ae7fc-6256-4387-a72f-dd24801e38f0', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ce0ae7fc-6256-4387-a72f-dd24801e38f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9704a8af-523f-407c-8a76-1ecd000b9d9a'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:12:19.888280 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-54d07af3-066e-466f-aa4d-b5c99beb2557 req-40eee31a-14dc-4047-823a-de2b36dd9906 tempest-LiveMigrationTest-1001758322 None] attachment_update completed successfully.
Jul 16 21:12:28.104394 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:12:28.125588 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Flow 'volume_create_manager' (32406ad2-2126-4088-bb25-29f89bc4c910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:12:28.132170 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81637099-9024-46fa-8cee-843038f05852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:12:28.152131 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81637099-9024-46fa-8cee-843038f05852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-394724469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b61a51e0-885e-44b7-8fc0-f32fe665e112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30d028fa9b854c8fb71c8cbed2985c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:12:28Z,use_quota=True,user_id='52281b3989a04ca2a50b0bc93bf783f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:12:28.157639 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bb8672-fb04-4b0f-a96c-edf8893beeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:12:28.161999 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bb8672-fb04-4b0f-a96c-edf8893beeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:12:28.169125 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f841883-ac2c-4dfe-afee-323f4e1c8a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:12:28.173261 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f841883-ac2c-4dfe-afee-323f4e1c8a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b61a51e0-885e-44b7-8fc0-f32fe665e112', 'volume_name': 'volume-b61a51e0-885e-44b7-8fc0-f32fe665e112', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:12:28.178065 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f85fc56-fdaa-42ba-a9b5-1cadc5698438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:12:28.182855 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f85fc56-fdaa-42ba-a9b5-1cadc5698438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:12:28.191158 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1ed83f-3ff3-4bd5-97f0-ac8c6d56c2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:12:28.191158 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Volume b61a51e0-885e-44b7-8fc0-f32fe665e112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b61a51e0-885e-44b7-8fc0-f32fe665e112', 'volume_size': 1}
Jul 16 21:12:28.191158 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] creating volume 'volume-b61a51e0-885e-44b7-8fc0-f32fe665e112' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:12:28.191158 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:12:28.670923 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:12:28.671373 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:12:28.675199 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1ed83f-3ff3-4bd5-97f0-ac8c6d56c2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b61a51e0-885e-44b7-8fc0-f32fe665e112', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:12:28.679763 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91d8897-a147-417b-b870-c94360d5d4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:12:28.902767 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Volume volume-b61a51e0-885e-44b7-8fc0-f32fe665e112 (b61a51e0-885e-44b7-8fc0-f32fe665e112): created successfully
Jul 16 21:12:28.908144 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91d8897-a147-417b-b870-c94360d5d4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:12:28.915047 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Flow 'volume_create_manager' (32406ad2-2126-4088-bb25-29f89bc4c910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:12:29.097625 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b647a774-130c-49ef-aabd-8de53b3093f3 tempest-VolumesAdminNegativeTest-1468695956 None] Created volume successfully.
Jul 16 21:12:31.644733 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=27,cinder:UPDATE=13 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:12:31.647631 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-9280269d-4616-4184-a44d-52201dfaa3d0 req-7c3c827b-4d1d-4372-b0af-52279e1e653e tempest-VolumesAdminNegativeTest-1468695956 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:12:33.300098 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-9280269d-4616-4184-a44d-52201dfaa3d0 req-7c3c827b-4d1d-4372-b0af-52279e1e653e tempest-VolumesAdminNegativeTest-1468695956 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.652s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:12:33.301200 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-9280269d-4616-4184-a44d-52201dfaa3d0 req-7c3c827b-4d1d-4372-b0af-52279e1e653e tempest-VolumesAdminNegativeTest-1468695956 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b61a51e0-885e-44b7-8fc0-f32fe665e112', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'b61a51e0-885e-44b7-8fc0-f32fe665e112', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:12:33.315983 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=26,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:12:33.426235 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-12f0ea29-8e29-4687-9c8b-86694dd73ade req-9e22db49-7dd2-43af-a9eb-24f5d8193a51 tempest-LiveMigrationTest-1131758637 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:12:33.458442 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-9280269d-4616-4184-a44d-52201dfaa3d0 req-7c3c827b-4d1d-4372-b0af-52279e1e653e tempest-VolumesAdminNegativeTest-1468695956 None] Connection info returned from driver {'name': 'volumes/volume-b61a51e0-885e-44b7-8fc0-f32fe665e112', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b61a51e0-885e-44b7-8fc0-f32fe665e112', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7600032e-85be-4f64-bbeb-cb95a3f15771'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:12:33.695110 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-9280269d-4616-4184-a44d-52201dfaa3d0 req-7c3c827b-4d1d-4372-b0af-52279e1e653e tempest-VolumesAdminNegativeTest-1468695956 None] attachment_update completed successfully.
Jul 16 21:12:34.212441 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:12:34.213369 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:12:34.277851 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:12:34.354927 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:12:34.793694 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-12f0ea29-8e29-4687-9c8b-86694dd73ade req-9e22db49-7dd2-43af-a9eb-24f5d8193a51 tempest-LiveMigrationTest-1131758637 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.368s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:12:34.794606 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-12f0ea29-8e29-4687-9c8b-86694dd73ade req-9e22db49-7dd2-43af-a9eb-24f5d8193a51 tempest-LiveMigrationTest-1131758637 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ce0ae7fc-6256-4387-a72f-dd24801e38f0', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'ce0ae7fc-6256-4387-a72f-dd24801e38f0', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:12:34.903749 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-12f0ea29-8e29-4687-9c8b-86694dd73ade req-9e22db49-7dd2-43af-a9eb-24f5d8193a51 tempest-LiveMigrationTest-1131758637 None] Connection info returned from driver {'name': 'volumes/volume-ce0ae7fc-6256-4387-a72f-dd24801e38f0', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ce0ae7fc-6256-4387-a72f-dd24801e38f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0c56182a-829c-4ea9-b591-99c784f55e20'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:12:35.126914 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-12f0ea29-8e29-4687-9c8b-86694dd73ade req-9e22db49-7dd2-43af-a9eb-24f5d8193a51 tempest-LiveMigrationTest-1131758637 None] attachment_update completed successfully.
Jul 16 21:12:42.231350 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-f4f0db99-37b1-489f-882c-61dbc48c2e9c req-03563511-c4c2-4972-a6de-0087993ac64d tempest-VolumesAdminNegativeTest-1468695956 None] Terminate volume connection completed successfully.
Jul 16 21:12:42.232086 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-f4f0db99-37b1-489f-882c-61dbc48c2e9c req-03563511-c4c2-4972-a6de-0087993ac64d tempest-VolumesAdminNegativeTest-1468695956 None] Deleting attachment 7600032e-85be-4f64-bbeb-cb95a3f15771. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:12:51.893729 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-12f0ea29-8e29-4687-9c8b-86694dd73ade req-395c5b67-4a8b-4408-a3fb-b81c91d4afac tempest-LiveMigrationTest-1131758637 None] Terminate volume connection completed successfully.
Jul 16 21:12:51.894903 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-12f0ea29-8e29-4687-9c8b-86694dd73ade req-395c5b67-4a8b-4408-a3fb-b81c91d4afac tempest-LiveMigrationTest-1131758637 None] Deleting attachment 9704a8af-523f-407c-8a76-1ecd000b9d9a. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:13:03.482150 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=45,cinder:UPDATE=6 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:13:03.609380 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:13:03.635700 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Flow 'volume_create_manager' (bf60f190-e263-40db-9442-04344d831feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:13:03.643199 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5d895b-1e4b-4bb1-a26e-400640f8d94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:13:03.658745 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5d895b-1e4b-4bb1-a26e-400640f8d94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1508780791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4f03adb7-f52d-4f10-8f7c-107b8e84874d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30d028fa9b854c8fb71c8cbed2985c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:13:03Z,use_quota=True,user_id='52281b3989a04ca2a50b0bc93bf783f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:13:03.664083 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ced1035-752e-4182-8813-83f57ea0980e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:13:03.668145 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ced1035-752e-4182-8813-83f57ea0980e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:13:03.673030 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35c4129-3665-4748-8906-e049960f8853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:13:03.677079 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35c4129-3665-4748-8906-e049960f8853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f03adb7-f52d-4f10-8f7c-107b8e84874d', 'volume_name': 'volume-4f03adb7-f52d-4f10-8f7c-107b8e84874d', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:13:03.682318 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5545c7-35ef-4ed8-8776-e12febc76b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:13:03.688159 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5545c7-35ef-4ed8-8776-e12febc76b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:13:03.690671 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f615efe-1019-4671-ae89-15b74a1f974d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:13:03.691763 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Volume 4f03adb7-f52d-4f10-8f7c-107b8e84874d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f03adb7-f52d-4f10-8f7c-107b8e84874d', 'volume_size': 1}
Jul 16 21:13:03.692158 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] creating volume 'volume-4f03adb7-f52d-4f10-8f7c-107b8e84874d' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:13:03.692819 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:13:04.352093 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:13:04.352534 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:13:04.356340 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f615efe-1019-4671-ae89-15b74a1f974d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f03adb7-f52d-4f10-8f7c-107b8e84874d', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:13:04.360838 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71cca4b-c053-45c5-956e-18a90a723a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:13:04.432950 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Volume volume-4f03adb7-f52d-4f10-8f7c-107b8e84874d (4f03adb7-f52d-4f10-8f7c-107b8e84874d): created successfully
Jul 16 21:13:04.436783 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71cca4b-c053-45c5-956e-18a90a723a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:13:04.443415 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Flow 'volume_create_manager' (bf60f190-e263-40db-9442-04344d831feb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:13:04.552720 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-6bd7a976-3f83-47b4-ba3a-28fc5cc747fa tempest-VolumesAdminNegativeTest-1468695956 None] Created volume successfully.
Jul 16 21:13:05.479341 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-a535b703-ec4a-47c0-a764-849da1ee02b0 req-4b907c55-2300-408d-8513-205556729e01 tempest-LiveMigrationTest-1001758322 None] Terminate volume connection completed successfully.
Jul 16 21:13:05.480029 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-a535b703-ec4a-47c0-a764-849da1ee02b0 req-4b907c55-2300-408d-8513-205556729e01 tempest-LiveMigrationTest-1001758322 None] Deleting attachment 0c56182a-829c-4ea9-b591-99c784f55e20. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:13:05.918131 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-7883e6bd-0968-4332-b0b3-a3a917b84aa8 tempest-VolumesAdminNegativeTest-1468695956 None] Acquiring lock "cinder-4f03adb7-f52d-4f10-8f7c-107b8e84874d-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:13:05.934676 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-7883e6bd-0968-4332-b0b3-a3a917b84aa8 tempest-VolumesAdminNegativeTest-1468695956 None] Lock "cinder-4f03adb7-f52d-4f10-8f7c-107b8e84874d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:13:05.939849 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=20,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:13:06.058201 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-7883e6bd-0968-4332-b0b3-a3a917b84aa8 tempest-VolumesAdminNegativeTest-1468695956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:13:06.341142 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-7883e6bd-0968-4332-b0b3-a3a917b84aa8 tempest-VolumesAdminNegativeTest-1468695956 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:13:06.349291 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-7883e6bd-0968-4332-b0b3-a3a917b84aa8 tempest-VolumesAdminNegativeTest-1468695956 None] Volume volume-4f03adb7-f52d-4f10-8f7c-107b8e84874d is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:13:06.492537 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-7883e6bd-0968-4332-b0b3-a3a917b84aa8 tempest-VolumesAdminNegativeTest-1468695956 None] deleting rbd volume volume-4f03adb7-f52d-4f10-8f7c-107b8e84874d {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:13:07.869982 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:13:07.891939 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Flow 'volume_create_manager' (b8b18e15-c234-4090-bb08-2f0830a9d2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:13:07.899148 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5319983-15c6-42bd-ba0d-c7742e439195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:13:07.928341 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5319983-15c6-42bd-ba0d-c7742e439195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-970528895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=eb5651c9-06af-46c0-905c-8ecec06e7945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b769bf8f3ea4e368bf68de1df6538f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:13:07Z,use_quota=True,user_id='6a69f9dee03d43beaafa966216b9e289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:13:07.934952 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d58605-7e6a-4c31-84cb-92a5d1ba0b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:13:07.939283 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d58605-7e6a-4c31-84cb-92a5d1ba0b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:13:07.944619 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b82648-eda8-4dbd-b675-c22a39eeba56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:13:08.062614 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b82648-eda8-4dbd-b675-c22a39eeba56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eb5651c9-06af-46c0-905c-8ecec06e7945', 'volume_name': 'volume-eb5651c9-06af-46c0-905c-8ecec06e7945', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958ef6c910>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:13:08.072862 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130d9e0d-cad2-4ef1-8fae-e974ee9e6f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:13:08.074074 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130d9e0d-cad2-4ef1-8fae-e974ee9e6f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:13:08.078844 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c21a8b4-dd3e-4dd0-99d9-ef6ef9ee3b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:13:08.080062 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Volume eb5651c9-06af-46c0-905c-8ecec06e7945: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eb5651c9-06af-46c0-905c-8ecec06e7945', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958ef6c910>}
Jul 16 21:13:08.080869 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Cloning eb5651c9-06af-46c0-905c-8ecec06e7945 from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9  at location (None, None). {{(pid=131857) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Jul 16 21:13:08.081818 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Acquiring lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" by "_prepare_image_cache_entry" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:13:08.101939 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:13:08.102458 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Preparing cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:889}}
Jul 16 21:13:08.103836 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Attempting to retrieve cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Jul 16 21:13:10.642244 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-7883e6bd-0968-4332-b0b3-a3a917b84aa8 tempest-VolumesAdminNegativeTest-1468695956 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:13:10.651520 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-7883e6bd-0968-4332-b0b3-a3a917b84aa8 tempest-VolumesAdminNegativeTest-1468695956 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:13:10.746935 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-7883e6bd-0968-4332-b0b3-a3a917b84aa8 tempest-VolumesAdminNegativeTest-1468695956 None] Created reservations ['bbdf8f4e-ffd9-46e5-9239-9952e4671a84', '003f5353-79f4-4763-806e-0228c5a9b7d4', 'f1695711-2255-4781-831b-0c22aaf7427b', '6c4d17ac-01b7-4676-93d8-72af0630753b'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:13:11.035196 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-7883e6bd-0968-4332-b0b3-a3a917b84aa8 tempest-VolumesAdminNegativeTest-1468695956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:13:11.148560 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-7883e6bd-0968-4332-b0b3-a3a917b84aa8 tempest-VolumesAdminNegativeTest-1468695956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:13:11.216652 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-7883e6bd-0968-4332-b0b3-a3a917b84aa8 tempest-VolumesAdminNegativeTest-1468695956 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:13:11.232801 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-7883e6bd-0968-4332-b0b3-a3a917b84aa8 tempest-VolumesAdminNegativeTest-1468695956 None] Deleted volume successfully.
Jul 16 21:13:11.774217 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-7883e6bd-0968-4332-b0b3-a3a917b84aa8 tempest-VolumesAdminNegativeTest-1468695956 None] Lock "cinder-4f03adb7-f52d-4f10-8f7c-107b8e84874d-delete_volume" released by "delete_volume" :: held 5.840s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:13:17.224923 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e35df366-9c88-4459-b3a9-4ee43925f1f4 tempest-VolumesAdminNegativeTest-1468695956 None] Acquiring lock "cinder-b61a51e0-885e-44b7-8fc0-f32fe665e112-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:13:17.254544 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e35df366-9c88-4459-b3a9-4ee43925f1f4 tempest-VolumesAdminNegativeTest-1468695956 None] Lock "cinder-b61a51e0-885e-44b7-8fc0-f32fe665e112-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:13:17.392950 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e35df366-9c88-4459-b3a9-4ee43925f1f4 tempest-VolumesAdminNegativeTest-1468695956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:13:17.603550 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e35df366-9c88-4459-b3a9-4ee43925f1f4 tempest-VolumesAdminNegativeTest-1468695956 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:13:17.611867 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e35df366-9c88-4459-b3a9-4ee43925f1f4 tempest-VolumesAdminNegativeTest-1468695956 None] Volume volume-b61a51e0-885e-44b7-8fc0-f32fe665e112 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:13:17.752967 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e35df366-9c88-4459-b3a9-4ee43925f1f4 tempest-VolumesAdminNegativeTest-1468695956 None] deleting rbd volume volume-b61a51e0-885e-44b7-8fc0-f32fe665e112 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:13:23.078752 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-e35df366-9c88-4459-b3a9-4ee43925f1f4 tempest-VolumesAdminNegativeTest-1468695956 None] Created reservations ['da39b834-c9cb-4ee2-8884-c4f0c01f18ca', '7aa8433d-f074-4dc3-b940-2c35f2ab78af', 'da08c914-8377-4c08-b7fe-5505e9e75d4e', '4c93821b-27b1-4cd8-87b3-e8fcd1c7fc7a'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:13:23.364967 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e35df366-9c88-4459-b3a9-4ee43925f1f4 tempest-VolumesAdminNegativeTest-1468695956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:13:23.437795 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e35df366-9c88-4459-b3a9-4ee43925f1f4 tempest-VolumesAdminNegativeTest-1468695956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:13:23.513933 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-e35df366-9c88-4459-b3a9-4ee43925f1f4 tempest-VolumesAdminNegativeTest-1468695956 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:13:23.520476 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e35df366-9c88-4459-b3a9-4ee43925f1f4 tempest-VolumesAdminNegativeTest-1468695956 None] Deleted volume successfully.
Jul 16 21:13:23.701097 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e35df366-9c88-4459-b3a9-4ee43925f1f4 tempest-VolumesAdminNegativeTest-1468695956 None] Lock "cinder-b61a51e0-885e-44b7-8fc0-f32fe665e112-delete_volume" released by "delete_volume" :: held 6.443s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:13:28.119197 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.image_utils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_l9ngtc8ancdv-master-1@ceph, size 616.00 MB, duration 20.01 sec {{(pid=131857) fetch /opt/stack/cinder/cinder/image/image_utils.py:587}}
Jul 16 21:13:28.120022 ncdv-master-1 cinder-volume[131857]: INFO cinder.image.image_utils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Image download 616.00 MB at 30.79 MB/s
Jul 16 21:13:28.168602 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_l9ngtc8ancdv-master-1@ceph {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:13:28.387376 ncdv-master-1 sudo[145658]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_l9ngtc8ancdv-master-1@ceph
Jul 16 21:13:28.388516 ncdv-master-1 sudo[145658]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jul 16 21:13:30.909557 ncdv-master-1 sudo[145658]: pam_unix(sudo:session): session closed for user root
Jul 16 21:13:30.911886 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_l9ngtc8ancdv-master-1@ceph" returned: 0 in 2.743s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:13:30.917924 ncdv-master-1 cinder-volume[131857]: WARNING py.warnings [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena'
Jul 16 21:13:30.917924 ncdv-master-1 cinder-volume[131857]:   debtcollector.deprecate(
Jul 16 21:13:30.917924 ncdv-master-1 cinder-volume[131857]: 
Jul 16 21:13:30.918902 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.image_utils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Temporary image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 is fetched for user 6a69f9dee03d43beaafa966216b9e289. {{(pid=131857) fetch /opt/stack/cinder/cinder/image/image_utils.py:1124}}
Jul 16 21:13:31.078690 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_l9ngtc8ancdv-master-1@ceph {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:13:31.386935 ncdv-master-1 sudo[145722]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_l9ngtc8ancdv-master-1@ceph
Jul 16 21:13:31.388764 ncdv-master-1 sudo[145722]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jul 16 21:13:33.918669 ncdv-master-1 sudo[145722]: pam_unix(sudo:session): session closed for user root
Jul 16 21:13:33.921590 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_l9ngtc8ancdv-master-1@ceph" returned: 0 in 2.843s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:13:33.922552 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] creating volume 'volume-eb5651c9-06af-46c0-905c-8ecec06e7945' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:13:33.923894 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:13:34.210955 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:13:34.211728 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:13:34.277769 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:13:34.365775 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:13:34.768068 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:13:34.769860 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:13:34.880233 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=41,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:13:34.958798 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Attempting download of 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 ((None, None)) to volume eb5651c9-06af-46c0-905c-8ecec06e7945. {{(pid=131857) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1181}}
Jul 16 21:13:35.033836 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_odz1xsya {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:13:35.171899 ncdv-master-1 sudo[145897]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_odz1xsya
Jul 16 21:13:35.173033 ncdv-master-1 sudo[145897]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jul 16 21:13:36.183991 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:13:36.231698 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Flow 'volume_create_manager' (273f14c2-ba1a-4620-8300-c8943af6fea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:13:36.239159 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068d51de-1e7d-4e49-ba00-022176f028d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:13:36.300157 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068d51de-1e7d-4e49-ba00-022176f028d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-609796080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=cc3f1f89-b013-47d9-982f-2e3f355e5391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9b92fc544c544f686ac2ab7ff5123b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:13:36Z,use_quota=True,user_id='578b87f863b34f57a571f7e56d44f118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:13:36.311575 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f2ec8c-43d2-4b5d-b5ca-53214d5809c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:13:36.313465 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f2ec8c-43d2-4b5d-b5ca-53214d5809c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:13:36.337938 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0d01fb-d01d-4f25-930f-51f774ea126f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:13:36.344095 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0d01fb-d01d-4f25-930f-51f774ea126f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc3f1f89-b013-47d9-982f-2e3f355e5391', 'volume_name': 'volume-cc3f1f89-b013-47d9-982f-2e3f355e5391', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:13:36.350645 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bfb1a57-7a23-48cf-bf10-1ef474dde29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:13:36.355912 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bfb1a57-7a23-48cf-bf10-1ef474dde29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:13:36.363355 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7e74f6-664a-4822-9d29-23a45e919c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:13:36.364905 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Volume cc3f1f89-b013-47d9-982f-2e3f355e5391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc3f1f89-b013-47d9-982f-2e3f355e5391', 'volume_size': 1}
Jul 16 21:13:36.379252 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] creating volume 'volume-cc3f1f89-b013-47d9-982f-2e3f355e5391' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:13:36.385042 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:13:37.134620 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:13:37.135272 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:13:37.139883 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7e74f6-664a-4822-9d29-23a45e919c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc3f1f89-b013-47d9-982f-2e3f355e5391', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:13:37.162765 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f41021-138f-4cda-914e-dd2ad3deb870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:13:37.249575 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Volume volume-cc3f1f89-b013-47d9-982f-2e3f355e5391 (cc3f1f89-b013-47d9-982f-2e3f355e5391): created successfully
Jul 16 21:13:37.254078 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f41021-138f-4cda-914e-dd2ad3deb870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:13:37.268109 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Flow 'volume_create_manager' (273f14c2-ba1a-4620-8300-c8943af6fea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:13:37.385908 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-c6ef6bd9-318c-4990-a7dc-63ffda3b7083 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Created volume successfully.
Jul 16 21:13:37.832820 ncdv-master-1 sudo[145897]: pam_unix(sudo:session): session closed for user root
Jul 16 21:13:37.834952 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_odz1xsya" returned: 0 in 2.801s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:13:37.835763 ncdv-master-1 cinder-volume[131857]: WARNING py.warnings [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena'
Jul 16 21:13:37.835763 ncdv-master-1 cinder-volume[131857]:   debtcollector.deprecate(
Jul 16 21:13:37.835763 ncdv-master-1 cinder-volume[131857]: 
Jul 16 21:13:37.837021 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_l9ngtc8ancdv-master-1@ceph {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:13:38.029881 ncdv-master-1 sudo[145990]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_l9ngtc8ancdv-master-1@ceph
Jul 16 21:13:38.031875 ncdv-master-1 sudo[145990]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jul 16 21:13:39.613787 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=43,cinder:INSERT=4,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:13:39.622090 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-c6629054-99e4-49d1-b1b3-a798d7593305 req-ba1ee20b-677e-4876-9450-2ef5bf9e48e0 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:13:40.605631 ncdv-master-1 sudo[145990]: pam_unix(sudo:session): session closed for user root
Jul 16 21:13:40.608201 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_l9ngtc8ancdv-master-1@ceph" returned: 0 in 2.771s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:13:40.609221 ncdv-master-1 cinder-volume[131857]: WARNING py.warnings [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena'
Jul 16 21:13:40.609221 ncdv-master-1 cinder-volume[131857]:   debtcollector.deprecate(
Jul 16 21:13:40.609221 ncdv-master-1 cinder-volume[131857]: 
Jul 16 21:13:40.609886 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.image_utils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 was vhdx, converting to raw {{(pid=131857) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:825}}
Jul 16 21:13:40.612094 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_l9ngtc8ancdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpj10_eevc {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:13:40.653912 ncdv-master-1 sudo[146120]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_l9ngtc8ancdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpj10_eevc
Jul 16 21:13:40.654731 ncdv-master-1 sudo[146120]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jul 16 21:13:41.218128 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-c6629054-99e4-49d1-b1b3-a798d7593305 req-ba1ee20b-677e-4876-9450-2ef5bf9e48e0 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.596s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:13:41.218986 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-c6629054-99e4-49d1-b1b3-a798d7593305 req-ba1ee20b-677e-4876-9450-2ef5bf9e48e0 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cc3f1f89-b013-47d9-982f-2e3f355e5391', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'cc3f1f89-b013-47d9-982f-2e3f355e5391', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:13:41.337333 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-c6629054-99e4-49d1-b1b3-a798d7593305 req-ba1ee20b-677e-4876-9450-2ef5bf9e48e0 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Connection info returned from driver {'name': 'volumes/volume-cc3f1f89-b013-47d9-982f-2e3f355e5391', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cc3f1f89-b013-47d9-982f-2e3f355e5391', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '99377b1f-18a0-494e-945c-50f4f1303404'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:13:41.678882 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-c6629054-99e4-49d1-b1b3-a798d7593305 req-ba1ee20b-677e-4876-9450-2ef5bf9e48e0 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] attachment_update completed successfully.
Jul 16 21:13:45.180474 ncdv-master-1 sudo[146120]: pam_unix(sudo:session): session closed for user root
Jul 16 21:13:45.182231 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_l9ngtc8ancdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpj10_eevc" returned: 0 in 4.571s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:13:45.184525 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_l9ngtc8ancdv-master-1@ceph {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:13:45.437176 ncdv-master-1 sudo[146282]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_l9ngtc8ancdv-master-1@ceph
Jul 16 21:13:45.441049 ncdv-master-1 sudo[146282]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jul 16 21:13:47.884362 ncdv-master-1 sudo[146282]: pam_unix(sudo:session): session closed for user root
Jul 16 21:13:47.887114 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_l9ngtc8ancdv-master-1@ceph" returned: 0 in 2.702s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:13:47.888377 ncdv-master-1 cinder-volume[131857]: WARNING py.warnings [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena'
Jul 16 21:13:47.888377 ncdv-master-1 cinder-volume[131857]:   debtcollector.deprecate(
Jul 16 21:13:47.888377 ncdv-master-1 cinder-volume[131857]: 
Jul 16 21:13:47.889547 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.image_utils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9_l9ngtc8ancdv-master-1@ceph, size 700.00 MB, duration 4.57 sec, destination /opt/stack/data/cinder/conversion/tmpj10_eevc {{(pid=131857) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:419}}
Jul 16 21:13:47.890014 ncdv-master-1 cinder-volume[131857]: INFO cinder.image.image_utils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Converted 700.00 MB image at 153.06 MB/s
Jul 16 21:13:47.891825 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:13:48.128442 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:13:48.129024 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:13:48.231262 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] deleting rbd volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:13:55.079388 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpj10_eevc volume-eb5651c9-06af-46c0-905c-8ecec06e7945 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:14:00.524743 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-c29ae4ae-e4ef-42f8-8928-cc66ca2cbfd8 req-6d8a9a5a-b30f-4d3e-b0d9-5ecc2d694811 tempest-LiveAutoBlockMigrationV225Test-1179203521 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:14:01.923567 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-c29ae4ae-e4ef-42f8-8928-cc66ca2cbfd8 req-6d8a9a5a-b30f-4d3e-b0d9-5ecc2d694811 tempest-LiveAutoBlockMigrationV225Test-1179203521 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.397s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:14:01.925315 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-c29ae4ae-e4ef-42f8-8928-cc66ca2cbfd8 req-6d8a9a5a-b30f-4d3e-b0d9-5ecc2d694811 tempest-LiveAutoBlockMigrationV225Test-1179203521 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cc3f1f89-b013-47d9-982f-2e3f355e5391', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'cc3f1f89-b013-47d9-982f-2e3f355e5391', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:14:02.104920 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-c29ae4ae-e4ef-42f8-8928-cc66ca2cbfd8 req-6d8a9a5a-b30f-4d3e-b0d9-5ecc2d694811 tempest-LiveAutoBlockMigrationV225Test-1179203521 None] Connection info returned from driver {'name': 'volumes/volume-cc3f1f89-b013-47d9-982f-2e3f355e5391', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cc3f1f89-b013-47d9-982f-2e3f355e5391', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f54b6d9f-ecb4-4c3e-8dcb-f9b6a34b148b'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:14:02.299110 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-c29ae4ae-e4ef-42f8-8928-cc66ca2cbfd8 req-6d8a9a5a-b30f-4d3e-b0d9-5ecc2d694811 tempest-LiveAutoBlockMigrationV225Test-1179203521 None] attachment_update completed successfully.
Jul 16 21:14:10.247127 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=33,cinder:UPDATE=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:14:19.291932 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=23,cinder:UPDATE=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:14:19.314422 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-c29ae4ae-e4ef-42f8-8928-cc66ca2cbfd8 req-1d453186-6cc1-4b24-8fe2-4e095929490a tempest-LiveAutoBlockMigrationV225Test-1179203521 None] Terminate volume connection completed successfully.
Jul 16 21:14:19.314422 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-c29ae4ae-e4ef-42f8-8928-cc66ca2cbfd8 req-1d453186-6cc1-4b24-8fe2-4e095929490a tempest-LiveAutoBlockMigrationV225Test-1179203521 None] Deleting attachment 99377b1f-18a0-494e-945c-50f4f1303404. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:14:34.211151 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:14:34.211928 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:14:34.265162 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:14:34.319385 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:14:37.060472 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-d86653b7-dbc3-4c7c-a47c-28258ad7d896 req-7e6603b1-d30e-4bd2-8f33-5b1d51a614cf tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Terminate volume connection completed successfully.
Jul 16 21:14:37.061091 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-d86653b7-dbc3-4c7c-a47c-28258ad7d896 req-7e6603b1-d30e-4bd2-8f33-5b1d51a614cf tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Deleting attachment f54b6d9f-ecb4-4c3e-8dcb-f9b6a34b148b. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:14:40.182247 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:14:40.221752 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Flow 'volume_create_manager' (b25b5ec2-409a-4608-85df-bac9b9c19396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:14:40.227383 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0122c37b-5a95-4c1d-906b-9852ffdd0d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:14:40.247438 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0122c37b-5a95-4c1d-906b-9852ffdd0d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1242115809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9b92fc544c544f686ac2ab7ff5123b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:14:40Z,use_quota=True,user_id='578b87f863b34f57a571f7e56d44f118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:14:40.254075 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea0295b-e9d9-4296-a505-d7e680e182a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:14:40.258893 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea0295b-e9d9-4296-a505-d7e680e182a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:14:40.265611 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d494083-49de-4862-93d4-f2a65654e642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:14:40.391312 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d494083-49de-4862-93d4-f2a65654e642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab', 'volume_name': 'volume-b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f67dca0>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:14:40.397755 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d7ea3f-af89-4c5a-89ce-b6eeea4c8227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:14:40.402351 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d7ea3f-af89-4c5a-89ce-b6eeea4c8227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:14:40.408099 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b475f5d8-9cb3-4c34-93b1-ba7e539fcf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:14:40.409545 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Volume b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f67dca0>}
Jul 16 21:14:40.410395 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Cloning b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9  at location (None, None). {{(pid=131857) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Jul 16 21:14:40.411489 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Acquiring lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" by "_prepare_image_cache_entry" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:14:50.285618 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=17,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:14:50.543648 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpj10_eevc volume-eb5651c9-06af-46c0-905c-8ecec06e7945 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 55.465s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:14:50.962407 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:14:52.328459 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:14:52.329079 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:14:52.329395 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Downloaded image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 ((None, None)) to volume eb5651c9-06af-46c0-905c-8ecec06e7945 successfully. {{(pid=131857) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1223}}
Jul 16 21:14:52.445923 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.image_utils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Temporary image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 for user 6a69f9dee03d43beaafa966216b9e289 is deleted. {{(pid=131857) fetch /opt/stack/cinder/cinder/image/image_utils.py:1128}}
Jul 16 21:14:52.543254 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:14:52.882009 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Created reservations ['d09163f4-aac1-4702-a731-3fc1abc21b34', '76106b04-0667-4af6-9412-0c91c43a076a', '4cfeba52-83a5-4c59-94a7-6ddbc7b5c5a3', 'cec82dc8-8d6a-4f16-a32b-1ef74b66ed2a'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:14:52.901264 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Creating image volume entry: {'bootable': False, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'updated_at': datetime.datetime(2022, 7, 16, 21, 13, 7, tzinfo=datetime.timezone.utc), 'project_id': 'c3045a89835d4e879a0ddc2557b831a3', 'consistencygroup_id': None, 'multiattach': False, 'provider_auth': None, 'metadata': {}, 'availability_zone': 'nova', 'service_uuid': None, 'provider_location': None, 'provider_geometry': None, 'volume_metadata': [], 'previous_status': None, 'user_id': '6a69f9dee03d43beaafa966216b9e289', 'replication_driver_data': None, 'deleted': False, 'launched_at': None, 'cluster_name': None, 'size': 1, 'display_name': 'image-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_type_id': 'ee624004-17a5-4a84-bbc4-1f0262571bd8', 'replication_status': None, 'created_at': datetime.datetime(2022, 7, 16, 21, 13, 7, tzinfo=datetime.timezone.utc), 'display_description': None, 'provider_id': None, 'scheduled_at': datetime.datetime(2022, 7, 16, 21, 13, 7, tzinfo=datetime.timezone.utc), 'host': 'ncdv-master-1@ceph#ceph', 'group_id': None, 'replication_extended_status': None, 'deleted_at': None, 'ec2_id': None, 'terminated_at': None, 'volume_admin_metadata': [], 'encryption_key_id': None, 'shared_targets': True, 'attach_status': 'detached', 'status': 'creating', 'source_volid': 'eb5651c9-06af-46c0-905c-8ecec06e7945'}. {{(pid=131857) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1620}}
Jul 16 21:14:53.320103 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Volume reschedule parameters: False retry: None {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:14:53.369816 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Flow 'volume_create_manager' (12e89f92-271a-4bf7-b1c4-bd041d0b162e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:14:53.386061 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c93c4d-a8e9-4f73-b985-8edc8bd06e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:14:53.418971 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c93c4d-a8e9-4f73-b985-8edc8bd06e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='image-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b59b3901-b32a-4d92-81b0-6b99e88e4517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3045a89835d4e879a0ddc2557b831a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=eb5651c9-06af-46c0-905c-8ecec06e7945,status='creating',terminated_at=None,updated_at=2022-07-16T21:13:07Z,use_quota=True,user_id='6a69f9dee03d43beaafa966216b9e289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:14:53.424783 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc12f0a8-e8e7-49a3-b688-8b533a0b0b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:14:53.429642 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc12f0a8-e8e7-49a3-b688-8b533a0b0b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:14:53.440588 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df9a10f-5329-4c39-8244-7aa7fd296fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:14:53.456068 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df9a10f-5329-4c39-8244-7aa7fd296fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'volume_name': 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517', 'volume_size': 1, 'source_volid': 'eb5651c9-06af-46c0-905c-8ecec06e7945', 'source_volstatus': 'downloading'}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:14:53.462089 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f548d6e-e69d-4ea0-9a9f-31b718480d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:14:53.468904 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f548d6e-e69d-4ea0-9a9f-31b718480d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:14:53.475153 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953208fd-d1cd-424f-a3f3-850515a7b0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:14:53.477276 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Volume b59b3901-b32a-4d92-81b0-6b99e88e4517: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517', 'volume_size': 1, 'source_volid': 'eb5651c9-06af-46c0-905c-8ecec06e7945', 'source_volstatus': 'downloading'}
Jul 16 21:14:53.493397 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:14:53.759764 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] creating snapshot='volume-b59b3901-b32a-4d92-81b0-6b99e88e4517.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:14:55.029596 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] cloning 'volume-eb5651c9-06af-46c0-905c-8ecec06e7945@volume-b59b3901-b32a-4d92-81b0-6b99e88e4517.clone_snap' to 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:14:56.421983 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:14:56.423922 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:14:56.424487 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:14:56.716461 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:14:56.724354 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953208fd-d1cd-424f-a3f3-850515a7b0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517', 'volume_size': 1, 'source_volid': 'eb5651c9-06af-46c0-905c-8ecec06e7945', 'source_volstatus': 'downloading'}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:14:56.737537 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3ab928-6722-4ace-90ae-c1a95ab1f77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:14:56.870257 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Volume volume-b59b3901-b32a-4d92-81b0-6b99e88e4517 (b59b3901-b32a-4d92-81b0-6b99e88e4517): created successfully
Jul 16 21:14:56.873887 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3ab928-6722-4ace-90ae-c1a95ab1f77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:14:56.886116 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Flow 'volume_create_manager' (12e89f92-271a-4bf7-b1c4-bd041d0b162e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:14:57.025691 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Created volume successfully.
Jul 16 21:14:57.275798 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Creating new image-volume cache entry for image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on ncdv-master-1@ceph#ceph {{(pid=131857) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}}
Jul 16 21:14:57.407151 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] New image-volume cache entry created: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 14, 57, 279217)}. {{(pid=131857) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}}
Jul 16 21:14:57.413256 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" released by "_prepare_image_cache_entry" :: held 109.320s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:14:57.413810 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Marking volume eb5651c9-06af-46c0-905c-8ecec06e7945 as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:14:57.550652 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Copying metadata from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 to eb5651c9-06af-46c0-905c-8ecec06e7945. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Jul 16 21:14:57.551345 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Creating volume glance metadata for volume eb5651c9-06af-46c0-905c-8ecec06e7945 backed by image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131857) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Jul 16 21:14:57.912879 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c21a8b4-dd3e-4dd0-99d9-ef6ef9ee3b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5651c9-06af-46c0-905c-8ecec06e7945', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958ef6c910>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:14:57.917832 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11af5640-ec30-4875-83c3-a413f7c9da05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:14:58.036559 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945 (eb5651c9-06af-46c0-905c-8ecec06e7945): created successfully
Jul 16 21:14:58.041668 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11af5640-ec30-4875-83c3-a413f7c9da05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:14:58.048115 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Flow 'volume_create_manager' (b8b18e15-c234-4090-bb08-2f0830a9d2fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:14:58.134279 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" acquired by "_prepare_image_cache_entry" :: waited 17.723s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:14:58.201260 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-ced5d46a-2155-43c2-8666-7f21b0b8a9cd tempest-LiveMigrationTest-1001758322 None] Created volume successfully.
Jul 16 21:14:58.267122 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 14, 58, 139223)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:14:58.268617 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:14:58.270615 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Found cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Jul 16 21:14:58.279228 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" released by "_prepare_image_cache_entry" :: held 0.144s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:14:58.281455 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Attempting to retrieve cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Jul 16 21:14:58.287321 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=59,cinder:UPDATE=18,cinder:INSERT=22,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:14:58.298157 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 14, 58, 294642)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:14:58.299038 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:14:58.299606 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Creating from source image-volume b59b3901-b32a-4d92-81b0-6b99e88e4517 {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Jul 16 21:14:58.337245 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:14:58.618443 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] creating snapshot='volume-b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:15:00.288785 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] cloning 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517@volume-b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab.clone_snap' to 'volume-b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:15:01.756090 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:15:01.761971 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:15:01.763033 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:15:02.153014 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:15:02.154017 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Marking volume b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:15:02.260021 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Copying metadata from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 to b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Jul 16 21:15:02.260675 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Creating volume glance metadata for volume b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab backed by image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131857) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Jul 16 21:15:02.496399 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b475f5d8-9cb3-4c34-93b1-ba7e539fcf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f67dca0>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:15:02.501653 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6af59fb-a6f8-4f31-af8f-dc3c05a992ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:15:02.601689 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Volume volume-b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab (b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab): created successfully
Jul 16 21:15:02.606229 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6af59fb-a6f8-4f31-af8f-dc3c05a992ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:15:02.613039 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Flow 'volume_create_manager' (b25b5ec2-409a-4608-85df-bac9b9c19396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:15:02.750476 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-ee2a56b1-3b47-4126-a71f-9e6554ac100c tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Created volume successfully.
Jul 16 21:15:04.981942 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-8f25d619-09e1-4071-8910-4b32863bbd42 req-c0b013c0-3807-48f1-b493-2533b74c2987 tempest-LiveMigrationTest-1001758322 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:15:06.876628 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-8f25d619-09e1-4071-8910-4b32863bbd42 req-c0b013c0-3807-48f1-b493-2533b74c2987 tempest-LiveMigrationTest-1001758322 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.894s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:15:06.877815 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-8f25d619-09e1-4071-8910-4b32863bbd42 req-c0b013c0-3807-48f1-b493-2533b74c2987 tempest-LiveMigrationTest-1001758322 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-eb5651c9-06af-46c0-905c-8ecec06e7945', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'eb5651c9-06af-46c0-905c-8ecec06e7945', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:15:07.042568 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-8f25d619-09e1-4071-8910-4b32863bbd42 req-c0b013c0-3807-48f1-b493-2533b74c2987 tempest-LiveMigrationTest-1001758322 None] Connection info returned from driver {'name': 'volumes/volume-eb5651c9-06af-46c0-905c-8ecec06e7945', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'eb5651c9-06af-46c0-905c-8ecec06e7945', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fcbbc1ee-41d3-4590-b8c8-66b7a23198f9'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:15:07.336796 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-8f25d619-09e1-4071-8910-4b32863bbd42 req-c0b013c0-3807-48f1-b493-2533b74c2987 tempest-LiveMigrationTest-1001758322 None] attachment_update completed successfully.
Jul 16 21:15:09.370488 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-d9673510-f870-4ce5-b805-a61fa4563efe req-48101366-084c-4e01-bbfd-28119d8c70ad tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:15:10.867756 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-d9673510-f870-4ce5-b805-a61fa4563efe req-48101366-084c-4e01-bbfd-28119d8c70ad tempest-LiveAutoBlockMigrationV225Test-1461646193 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.491s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:15:10.869816 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-d9673510-f870-4ce5-b805-a61fa4563efe req-48101366-084c-4e01-bbfd-28119d8c70ad tempest-LiveAutoBlockMigrationV225Test-1461646193 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:15:11.058551 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-d9673510-f870-4ce5-b805-a61fa4563efe req-48101366-084c-4e01-bbfd-28119d8c70ad tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Connection info returned from driver {'name': 'volumes/volume-b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bfef8cdf-8a3e-444a-b64f-6c5244e55158'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:15:11.239254 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-d9673510-f870-4ce5-b805-a61fa4563efe req-48101366-084c-4e01-bbfd-28119d8c70ad tempest-LiveAutoBlockMigrationV225Test-1461646193 None] attachment_update completed successfully.
Jul 16 21:15:30.315307 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=63,cinder:UPDATE=11,cinder:INSERT=14,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:15:34.216827 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:15:34.218416 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:15:34.292101 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:15:34.357776 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:15:40.305816 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=25,cinder:UPDATE=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:15:40.911249 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:15:40.992617 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Flow 'volume_create_manager' (d2875757-4b45-4cb2-a73c-513198f10bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:15:41.015031 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f60815-6160-4962-93a9-5fb7daa94a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:15:41.079963 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f60815-6160-4962-93a9-5fb7daa94a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-738301929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7fa5082b-070c-4f64-9f0b-f24264ffca4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d82c2d92c67f469e863eb70bb7f9af84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:15:41Z,use_quota=True,user_id='1aa99be675e946fd995d71465b4cbec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:15:41.106415 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422e76ae-e55b-4a1f-9740-abb79435190d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:15:41.124287 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422e76ae-e55b-4a1f-9740-abb79435190d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:15:41.139166 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afaa49b-6ac7-46e5-980a-0602b7541e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:15:41.284585 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afaa49b-6ac7-46e5-980a-0602b7541e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7fa5082b-070c-4f64-9f0b-f24264ffca4a', 'volume_name': 'volume-7fa5082b-070c-4f64-9f0b-f24264ffca4a', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f5e2f40>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:15:41.293497 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d5508c-eb45-4b13-b4d4-5f04b285e872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:15:41.303365 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d5508c-eb45-4b13-b4d4-5f04b285e872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:15:41.308513 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5d1930-7c17-4b85-a075-9840c547f0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:15:41.309801 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Volume 7fa5082b-070c-4f64-9f0b-f24264ffca4a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7fa5082b-070c-4f64-9f0b-f24264ffca4a', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f5e2f40>}
Jul 16 21:15:41.310497 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Cloning 7fa5082b-070c-4f64-9f0b-f24264ffca4a from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9  at location (None, None). {{(pid=131857) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Jul 16 21:15:41.311853 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Acquiring lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" by "_prepare_image_cache_entry" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:15:41.322921 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:15:41.603361 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 15, 41, 327809)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:15:41.603361 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:15:41.603361 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Found cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Jul 16 21:15:41.604702 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" released by "_prepare_image_cache_entry" :: held 0.282s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:15:41.605788 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Attempting to retrieve cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Jul 16 21:15:41.726341 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 15, 41, 610427)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:15:41.727106 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:15:41.727666 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Creating from source image-volume b59b3901-b32a-4d92-81b0-6b99e88e4517 {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Jul 16 21:15:41.751822 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:15:42.018622 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] creating snapshot='volume-7fa5082b-070c-4f64-9f0b-f24264ffca4a.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:15:43.542209 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] cloning 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517@volume-7fa5082b-070c-4f64-9f0b-f24264ffca4a.clone_snap' to 'volume-7fa5082b-070c-4f64-9f0b-f24264ffca4a' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:15:43.601793 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-04a95fcb-5164-4efb-833f-82c94fd8a734 req-12c3c7a0-4257-4b3d-971f-b4fdb3aebcc8 tempest-LiveMigrationTest-1131758637 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:15:44.851407 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:15:44.866499 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:15:44.867531 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:15:45.260694 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:15:45.261655 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Marking volume 7fa5082b-070c-4f64-9f0b-f24264ffca4a as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:15:45.278892 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-04a95fcb-5164-4efb-833f-82c94fd8a734 req-12c3c7a0-4257-4b3d-971f-b4fdb3aebcc8 tempest-LiveMigrationTest-1131758637 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.677s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:15:45.282285 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-04a95fcb-5164-4efb-833f-82c94fd8a734 req-12c3c7a0-4257-4b3d-971f-b4fdb3aebcc8 tempest-LiveMigrationTest-1131758637 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-eb5651c9-06af-46c0-905c-8ecec06e7945', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'eb5651c9-06af-46c0-905c-8ecec06e7945', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:15:45.375290 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Copying metadata from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 to 7fa5082b-070c-4f64-9f0b-f24264ffca4a. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Jul 16 21:15:45.375732 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Creating volume glance metadata for volume 7fa5082b-070c-4f64-9f0b-f24264ffca4a backed by image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131857) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Jul 16 21:15:45.415072 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-04a95fcb-5164-4efb-833f-82c94fd8a734 req-12c3c7a0-4257-4b3d-971f-b4fdb3aebcc8 tempest-LiveMigrationTest-1131758637 None] Connection info returned from driver {'name': 'volumes/volume-eb5651c9-06af-46c0-905c-8ecec06e7945', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'eb5651c9-06af-46c0-905c-8ecec06e7945', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f20dbe82-6ca0-400e-b79d-5a21e8f5eb81'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:15:45.570961 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5d1930-7c17-4b85-a075-9840c547f0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fa5082b-070c-4f64-9f0b-f24264ffca4a', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f5e2f40>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:15:45.575522 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b62416cc-d8cc-4bf4-999c-8cadfdd1eae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:15:45.630886 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-04a95fcb-5164-4efb-833f-82c94fd8a734 req-12c3c7a0-4257-4b3d-971f-b4fdb3aebcc8 tempest-LiveMigrationTest-1131758637 None] attachment_update completed successfully.
Jul 16 21:15:45.689504 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Volume volume-7fa5082b-070c-4f64-9f0b-f24264ffca4a (7fa5082b-070c-4f64-9f0b-f24264ffca4a): created successfully
Jul 16 21:15:45.702411 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b62416cc-d8cc-4bf4-999c-8cadfdd1eae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:15:45.708799 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Flow 'volume_create_manager' (d2875757-4b45-4cb2-a73c-513198f10bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:15:45.788973 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-c3063f44-407a-464b-960c-6407825a8f01 tempest-ServersTestBootFromVolume-1080567873 None] Created volume successfully.
Jul 16 21:15:50.593225 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-3b2a7d41-310c-48ce-b408-bf9f38c73a24 req-592573c9-17ca-4f00-9e2d-b4e8dba68966 tempest-LiveAutoBlockMigrationV225Test-1179203521 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:15:52.269282 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-3b2a7d41-310c-48ce-b408-bf9f38c73a24 req-592573c9-17ca-4f00-9e2d-b4e8dba68966 tempest-LiveAutoBlockMigrationV225Test-1179203521 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.676s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:15:52.270248 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-3b2a7d41-310c-48ce-b408-bf9f38c73a24 req-592573c9-17ca-4f00-9e2d-b4e8dba68966 tempest-LiveAutoBlockMigrationV225Test-1179203521 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:15:52.417647 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-3b2a7d41-310c-48ce-b408-bf9f38c73a24 req-592573c9-17ca-4f00-9e2d-b4e8dba68966 tempest-LiveAutoBlockMigrationV225Test-1179203521 None] Connection info returned from driver {'name': 'volumes/volume-b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f9c7b3bd-ea66-400e-a69e-6b6e82b5e18e'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:15:52.661483 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-3b2a7d41-310c-48ce-b408-bf9f38c73a24 req-592573c9-17ca-4f00-9e2d-b4e8dba68966 tempest-LiveAutoBlockMigrationV225Test-1179203521 None] attachment_update completed successfully.
Jul 16 21:15:53.702049 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-827020c3-b1da-40ae-8aae-d3c2ea617930 req-2b75168a-ef6e-4b31-86cb-70fc207ff123 tempest-ServersTestBootFromVolume-1080567873 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:15:54.688895 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-827020c3-b1da-40ae-8aae-d3c2ea617930 req-2b75168a-ef6e-4b31-86cb-70fc207ff123 tempest-ServersTestBootFromVolume-1080567873 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.986s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:15:54.690604 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-827020c3-b1da-40ae-8aae-d3c2ea617930 req-2b75168a-ef6e-4b31-86cb-70fc207ff123 tempest-ServersTestBootFromVolume-1080567873 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7fa5082b-070c-4f64-9f0b-f24264ffca4a', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '7fa5082b-070c-4f64-9f0b-f24264ffca4a', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:15:54.833595 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-827020c3-b1da-40ae-8aae-d3c2ea617930 req-2b75168a-ef6e-4b31-86cb-70fc207ff123 tempest-ServersTestBootFromVolume-1080567873 None] Connection info returned from driver {'name': 'volumes/volume-7fa5082b-070c-4f64-9f0b-f24264ffca4a', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7fa5082b-070c-4f64-9f0b-f24264ffca4a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bd0c98c2-19ec-4cce-8e61-c086d28da019'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:15:55.017594 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-827020c3-b1da-40ae-8aae-d3c2ea617930 req-2b75168a-ef6e-4b31-86cb-70fc207ff123 tempest-ServersTestBootFromVolume-1080567873 None] attachment_update completed successfully.
Jul 16 21:15:56.152827 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-04a95fcb-5164-4efb-833f-82c94fd8a734 req-74bad381-261c-45b2-a04b-2b16be04aded tempest-LiveMigrationTest-1131758637 None] Terminate volume connection completed successfully.
Jul 16 21:15:56.153540 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-04a95fcb-5164-4efb-833f-82c94fd8a734 req-74bad381-261c-45b2-a04b-2b16be04aded tempest-LiveMigrationTest-1131758637 None] Deleting attachment fcbbc1ee-41d3-4590-b8c8-66b7a23198f9. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:16:05.894994 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=63,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:16:05.902311 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-3b2a7d41-310c-48ce-b408-bf9f38c73a24 req-ea482f87-1f76-497f-af23-bb95720ec6d4 tempest-LiveAutoBlockMigrationV225Test-1179203521 None] Terminate volume connection completed successfully.
Jul 16 21:16:05.902797 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-3b2a7d41-310c-48ce-b408-bf9f38c73a24 req-ea482f87-1f76-497f-af23-bb95720ec6d4 tempest-LiveAutoBlockMigrationV225Test-1179203521 None] Deleting attachment bfef8cdf-8a3e-444a-b64f-6c5244e55158. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:16:13.603729 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-4cf1d522-e5ef-47d2-baf0-514cc1ae1142 req-d58ea115-3293-487b-9a39-e821054cb1d4 tempest-LiveMigrationTest-1001758322 None] Terminate volume connection completed successfully.
Jul 16 21:16:13.605532 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-4cf1d522-e5ef-47d2-baf0-514cc1ae1142 req-d58ea115-3293-487b-9a39-e821054cb1d4 tempest-LiveMigrationTest-1001758322 None] Deleting attachment f20dbe82-6ca0-400e-b79d-5a21e8f5eb81. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:16:14.078929 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-4cf1d522-e5ef-47d2-baf0-514cc1ae1142 req-b193fa82-b1ea-4da2-a456-3c9c4da37498 tempest-LiveMigrationTest-1001758322 None] Acquiring lock "cinder-eb5651c9-06af-46c0-905c-8ecec06e7945-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:16:14.099247 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-4cf1d522-e5ef-47d2-baf0-514cc1ae1142 req-b193fa82-b1ea-4da2-a456-3c9c4da37498 tempest-LiveMigrationTest-1001758322 None] Lock "cinder-eb5651c9-06af-46c0-905c-8ecec06e7945-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:16:14.393509 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-4cf1d522-e5ef-47d2-baf0-514cc1ae1142 req-b193fa82-b1ea-4da2-a456-3c9c4da37498 tempest-LiveMigrationTest-1001758322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:16:14.681902 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-4cf1d522-e5ef-47d2-baf0-514cc1ae1142 req-b193fa82-b1ea-4da2-a456-3c9c4da37498 tempest-LiveMigrationTest-1001758322 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:16:14.682562 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-4cf1d522-e5ef-47d2-baf0-514cc1ae1142 req-b193fa82-b1ea-4da2-a456-3c9c4da37498 tempest-LiveMigrationTest-1001758322 None] volume has clone snapshot(s) {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1288}}
Jul 16 21:16:14.684406 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-4cf1d522-e5ef-47d2-baf0-514cc1ae1142 req-b193fa82-b1ea-4da2-a456-3c9c4da37498 tempest-LiveMigrationTest-1001758322 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:16:16.517166 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-50daffa9-9787-4c44-b7df-b09b5c04f09d tempest-LiveMigrationTest-1001758322 None] Acquiring lock "cinder-ce0ae7fc-6256-4387-a72f-dd24801e38f0-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:16:16.536052 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-50daffa9-9787-4c44-b7df-b09b5c04f09d tempest-LiveMigrationTest-1001758322 None] Lock "cinder-ce0ae7fc-6256-4387-a72f-dd24801e38f0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:16:16.551758 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=56,cinder:UPDATE=9,cinder:INSERT=9,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:16:16.761020 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-50daffa9-9787-4c44-b7df-b09b5c04f09d tempest-LiveMigrationTest-1001758322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:16:17.234054 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-50daffa9-9787-4c44-b7df-b09b5c04f09d tempest-LiveMigrationTest-1001758322 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:16:17.234772 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-50daffa9-9787-4c44-b7df-b09b5c04f09d tempest-LiveMigrationTest-1001758322 None] Volume volume-ce0ae7fc-6256-4387-a72f-dd24801e38f0 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:16:17.708780 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-50daffa9-9787-4c44-b7df-b09b5c04f09d tempest-LiveMigrationTest-1001758322 None] deleting rbd volume volume-ce0ae7fc-6256-4387-a72f-dd24801e38f0 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:16:18.835597 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [req-4cf1d522-e5ef-47d2-baf0-514cc1ae1142 req-b193fa82-b1ea-4da2-a456-3c9c4da37498 tempest-LiveMigrationTest-1001758322 None] Created reservations ['8a92d61f-c92c-4c6c-807d-e70388433c2c', '1d768913-0b00-43cc-8ff8-331ff58855d6', '0b4223a0-dfca-46a3-80a9-a2d53a9bfd79', '57878e53-5fee-40ff-b3cd-b7d6fcbbda43'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:16:19.291504 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-4cf1d522-e5ef-47d2-baf0-514cc1ae1142 req-b193fa82-b1ea-4da2-a456-3c9c4da37498 tempest-LiveMigrationTest-1001758322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:16:19.464548 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-4cf1d522-e5ef-47d2-baf0-514cc1ae1142 req-b193fa82-b1ea-4da2-a456-3c9c4da37498 tempest-LiveMigrationTest-1001758322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:16:19.540710 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [req-4cf1d522-e5ef-47d2-baf0-514cc1ae1142 req-b193fa82-b1ea-4da2-a456-3c9c4da37498 tempest-LiveMigrationTest-1001758322 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:16:19.551909 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-4cf1d522-e5ef-47d2-baf0-514cc1ae1142 req-b193fa82-b1ea-4da2-a456-3c9c4da37498 tempest-LiveMigrationTest-1001758322 None] Deleted volume successfully.
Jul 16 21:16:19.815486 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-4cf1d522-e5ef-47d2-baf0-514cc1ae1142 req-b193fa82-b1ea-4da2-a456-3c9c4da37498 tempest-LiveMigrationTest-1001758322 None] Lock "cinder-eb5651c9-06af-46c0-905c-8ecec06e7945-delete_volume" released by "delete_volume" :: held 5.716s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:16:20.655484 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-f4bb3cae-5d2a-4ba4-8874-7c929cf735ea req-dfb9f9c8-c2f5-4d25-87d6-7f130fe91947 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Terminate volume connection completed successfully.
Jul 16 21:16:20.656831 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-f4bb3cae-5d2a-4ba4-8874-7c929cf735ea req-dfb9f9c8-c2f5-4d25-87d6-7f130fe91947 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Deleting attachment f9c7b3bd-ea66-400e-a69e-6b6e82b5e18e. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:16:21.123241 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-f4bb3cae-5d2a-4ba4-8874-7c929cf735ea req-58a32f00-fcc8-4cc9-8794-ce7ba2024939 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Acquiring lock "cinder-b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:16:21.134307 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-f4bb3cae-5d2a-4ba4-8874-7c929cf735ea req-58a32f00-fcc8-4cc9-8794-ce7ba2024939 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Lock "cinder-b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:16:21.343610 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-f4bb3cae-5d2a-4ba4-8874-7c929cf735ea req-58a32f00-fcc8-4cc9-8794-ce7ba2024939 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:16:21.792754 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-f4bb3cae-5d2a-4ba4-8874-7c929cf735ea req-58a32f00-fcc8-4cc9-8794-ce7ba2024939 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:16:22.229495 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-f4bb3cae-5d2a-4ba4-8874-7c929cf735ea req-58a32f00-fcc8-4cc9-8794-ce7ba2024939 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] deleting rbd volume volume-b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:16:23.284701 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e568c311-d0a2-4c15-bccc-7168dd0f45aa tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Acquiring lock "cinder-cc3f1f89-b013-47d9-982f-2e3f355e5391-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:16:23.296885 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e568c311-d0a2-4c15-bccc-7168dd0f45aa tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Lock "cinder-cc3f1f89-b013-47d9-982f-2e3f355e5391-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:16:23.450857 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e568c311-d0a2-4c15-bccc-7168dd0f45aa tempest-LiveAutoBlockMigrationV225Test-1461646193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:16:23.902080 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e568c311-d0a2-4c15-bccc-7168dd0f45aa tempest-LiveAutoBlockMigrationV225Test-1461646193 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:16:23.908060 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e568c311-d0a2-4c15-bccc-7168dd0f45aa tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Volume volume-cc3f1f89-b013-47d9-982f-2e3f355e5391 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:16:24.212304 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e568c311-d0a2-4c15-bccc-7168dd0f45aa tempest-LiveAutoBlockMigrationV225Test-1461646193 None] deleting rbd volume volume-cc3f1f89-b013-47d9-982f-2e3f355e5391 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:16:25.132488 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-50daffa9-9787-4c44-b7df-b09b5c04f09d tempest-LiveMigrationTest-1001758322 None] Created reservations ['8edb4ba0-23ef-4ed9-a0b5-2f7d6fdcc59f', '42c39124-051a-452f-b0b2-79cabec4877d', '104f8cb5-9ea4-40b2-b5ea-3ba278a0ae3d', '6cb2e3de-c5f0-4db2-8785-da35368c9e39'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:16:25.571701 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-50daffa9-9787-4c44-b7df-b09b5c04f09d tempest-LiveMigrationTest-1001758322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:16:25.659090 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-50daffa9-9787-4c44-b7df-b09b5c04f09d tempest-LiveMigrationTest-1001758322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:16:25.871189 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-50daffa9-9787-4c44-b7df-b09b5c04f09d tempest-LiveMigrationTest-1001758322 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:16:25.878501 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-50daffa9-9787-4c44-b7df-b09b5c04f09d tempest-LiveMigrationTest-1001758322 None] Deleted volume successfully.
Jul 16 21:16:25.995611 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-50daffa9-9787-4c44-b7df-b09b5c04f09d tempest-LiveMigrationTest-1001758322 None] Lock "cinder-ce0ae7fc-6256-4387-a72f-dd24801e38f0-delete_volume" released by "delete_volume" :: held 9.459s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:16:30.587148 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-f4bb3cae-5d2a-4ba4-8874-7c929cf735ea req-58a32f00-fcc8-4cc9-8794-ce7ba2024939 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:16:30.876606 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-f4bb3cae-5d2a-4ba4-8874-7c929cf735ea req-58a32f00-fcc8-4cc9-8794-ce7ba2024939 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] deleting parent snapshot volume-b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:16:34.808646 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:16:34.809888 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:16:34.877860 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:16:34.963284 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:16:35.016626 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=64,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:16:35.197990 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-e568c311-d0a2-4c15-bccc-7168dd0f45aa tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Created reservations ['81ab9133-1104-4b9b-9c6b-5e3f320331fa', 'a83c7b01-9f2d-4412-91ee-bb109095e993', '70c180f9-4eff-42b5-b34e-ddfb0d91e555', 'be3416d3-9624-44d2-bf3d-3616b39f0ba0'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:16:35.326211 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [req-f4bb3cae-5d2a-4ba4-8874-7c929cf735ea req-58a32f00-fcc8-4cc9-8794-ce7ba2024939 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Created reservations ['93ed7c66-6c0d-4a5d-b6ad-95d8842ea547', '48cdee99-7254-4332-9582-ebe7c2014886', '220e2fe8-e4ff-4166-bb91-989109b1a548', 'd8587cab-0ff9-465b-b850-627ecede8eca'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:16:35.540709 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e568c311-d0a2-4c15-bccc-7168dd0f45aa tempest-LiveAutoBlockMigrationV225Test-1461646193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:16:35.628955 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e568c311-d0a2-4c15-bccc-7168dd0f45aa tempest-LiveAutoBlockMigrationV225Test-1461646193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:16:35.720244 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-e568c311-d0a2-4c15-bccc-7168dd0f45aa tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:16:35.735698 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e568c311-d0a2-4c15-bccc-7168dd0f45aa tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Deleted volume successfully.
Jul 16 21:16:35.852575 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-f4bb3cae-5d2a-4ba4-8874-7c929cf735ea req-58a32f00-fcc8-4cc9-8794-ce7ba2024939 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:16:35.941884 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-f4bb3cae-5d2a-4ba4-8874-7c929cf735ea req-58a32f00-fcc8-4cc9-8794-ce7ba2024939 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:16:36.080205 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [req-f4bb3cae-5d2a-4ba4-8874-7c929cf735ea req-58a32f00-fcc8-4cc9-8794-ce7ba2024939 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:16:36.086378 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e568c311-d0a2-4c15-bccc-7168dd0f45aa tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Lock "cinder-cc3f1f89-b013-47d9-982f-2e3f355e5391-delete_volume" released by "delete_volume" :: held 12.789s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:16:36.087735 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-f4bb3cae-5d2a-4ba4-8874-7c929cf735ea req-58a32f00-fcc8-4cc9-8794-ce7ba2024939 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Deleted volume successfully.
Jul 16 21:16:36.191243 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-f4bb3cae-5d2a-4ba4-8874-7c929cf735ea req-58a32f00-fcc8-4cc9-8794-ce7ba2024939 tempest-LiveAutoBlockMigrationV225Test-1461646193 None] Lock "cinder-b73aa13f-ef6f-4a53-a7a2-c8ef03eab5ab-delete_volume" released by "delete_volume" :: held 15.057s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:16:50.314743 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=48,cinder:UPDATE=40,cinder:INSERT=10,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:17:10.313412 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:17:30.318973 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:17:34.811126 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:17:34.812706 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:17:34.882055 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:17:34.971130 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:17:40.335954 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:18:00.328398 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:18:20.337039 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:18:20.338377 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:18:40.350617 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:18:56.471660 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:18:56.534258 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:18:56.557253 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Flow 'volume_create_manager' (f773f267-5b17-42d1-a9d6-d322eec304d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:18:56.563713 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2accf21d-3efa-4e0e-b37d-5e6aa0003047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:18:56.581809 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2accf21d-3efa-4e0e-b37d-5e6aa0003047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1584104127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4450505c-3ac5-42c2-b94c-b8f945007d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942725b966874321b6ccd6f628787d06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:18:56Z,use_quota=True,user_id='6a3dbbb2b39447d884c56dfd0db7e42e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:18:56.587786 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b789394-29d9-41a5-a450-d59f61759018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:18:56.592635 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b789394-29d9-41a5-a450-d59f61759018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:18:56.598077 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d11a613-754b-4b5b-8f47-64a9ee3cb279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:18:56.607453 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d11a613-754b-4b5b-8f47-64a9ee3cb279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4450505c-3ac5-42c2-b94c-b8f945007d50', 'volume_name': 'volume-4450505c-3ac5-42c2-b94c-b8f945007d50', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:18:56.612279 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3514f7fb-81f3-4719-ae69-b64118bd28f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:18:56.616206 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3514f7fb-81f3-4719-ae69-b64118bd28f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:18:56.620871 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f498655-6ab8-402b-b3e4-b57d80cd9f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:18:56.622131 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Volume 4450505c-3ac5-42c2-b94c-b8f945007d50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4450505c-3ac5-42c2-b94c-b8f945007d50', 'volume_size': 1}
Jul 16 21:18:56.622701 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] creating volume 'volume-4450505c-3ac5-42c2-b94c-b8f945007d50' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:18:56.623653 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:18:57.161954 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:18:57.162626 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:18:57.169951 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f498655-6ab8-402b-b3e4-b57d80cd9f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4450505c-3ac5-42c2-b94c-b8f945007d50', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:18:57.182712 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9ca51e-22e5-4ddd-875b-a2d67d9bf551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:18:57.309398 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Volume volume-4450505c-3ac5-42c2-b94c-b8f945007d50 (4450505c-3ac5-42c2-b94c-b8f945007d50): created successfully
Jul 16 21:18:57.313111 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9ca51e-22e5-4ddd-875b-a2d67d9bf551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:18:57.319515 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Flow 'volume_create_manager' (f773f267-5b17-42d1-a9d6-d322eec304d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:18:57.453435 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-0b7ca605-0c7a-4f9c-a419-f42aab606c2e req-77a57963-0f5e-4ced-9daf-fd6ba4f3dd3b tempest-VolumesSnapshotsTestJSON-851680556 None] Created volume successfully.
Jul 16 21:18:58.977120 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-d8a3f53e-5e7f-42d0-9673-e33d309e143e req-d7763809-feab-409d-9e22-728ae415341e tempest-VolumesSnapshotsTestJSON-851680556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:19:02.340808 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-d8a3f53e-5e7f-42d0-9673-e33d309e143e req-d7763809-feab-409d-9e22-728ae415341e tempest-VolumesSnapshotsTestJSON-851680556 None] Create snapshot completed successfully
Jul 16 21:19:03.893028 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-2b346903-4553-4f28-9a57-1ffcc26ebce4 req-8c5ee2df-d696-4764-bfd4-699407cb193d tempest-VolumesSnapshotsTestJSON-851680556 None] Acquiring lock "cinder-b6ec78c5-d133-485b-8009-7628a73d4739-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:19:03.904386 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-2b346903-4553-4f28-9a57-1ffcc26ebce4 req-8c5ee2df-d696-4764-bfd4-699407cb193d tempest-VolumesSnapshotsTestJSON-851680556 None] Lock "cinder-b6ec78c5-d133-485b-8009-7628a73d4739-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:19:03.906220 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-2b346903-4553-4f28-9a57-1ffcc26ebce4 req-8c5ee2df-d696-4764-bfd4-699407cb193d tempest-VolumesSnapshotsTestJSON-851680556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:19:07.507258 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [req-2b346903-4553-4f28-9a57-1ffcc26ebce4 req-8c5ee2df-d696-4764-bfd4-699407cb193d tempest-VolumesSnapshotsTestJSON-851680556 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:19:07.601022 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [req-2b346903-4553-4f28-9a57-1ffcc26ebce4 req-8c5ee2df-d696-4764-bfd4-699407cb193d tempest-VolumesSnapshotsTestJSON-851680556 None] Created reservations ['c2d3b064-3910-4a63-8507-45badf4e55b7', '9eb51fed-4fae-46ce-a3da-9681b5091fe9', '2a4a8c91-e1d2-454e-98ce-9600c4031d4c', '8556b1fd-b171-4191-8b56-8df5408a6037'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:19:07.894829 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-2b346903-4553-4f28-9a57-1ffcc26ebce4 req-8c5ee2df-d696-4764-bfd4-699407cb193d tempest-VolumesSnapshotsTestJSON-851680556 None] Delete snapshot completed successfully.
Jul 16 21:19:07.907574 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-2b346903-4553-4f28-9a57-1ffcc26ebce4 req-8c5ee2df-d696-4764-bfd4-699407cb193d tempest-VolumesSnapshotsTestJSON-851680556 None] Lock "cinder-b6ec78c5-d133-485b-8009-7628a73d4739-delete_snapshot" released by "delete_snapshot" :: held 4.003s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:19:09.461973 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-991f94ab-c90f-41be-844e-aa2f9468bcdb req-9b01ebd1-f61d-485e-9588-83692bdc2927 tempest-VolumesSnapshotsTestJSON-851680556 None] Acquiring lock "cinder-4450505c-3ac5-42c2-b94c-b8f945007d50-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:19:09.502794 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-991f94ab-c90f-41be-844e-aa2f9468bcdb req-9b01ebd1-f61d-485e-9588-83692bdc2927 tempest-VolumesSnapshotsTestJSON-851680556 None] Lock "cinder-4450505c-3ac5-42c2-b94c-b8f945007d50-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:19:09.692726 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-991f94ab-c90f-41be-844e-aa2f9468bcdb req-9b01ebd1-f61d-485e-9588-83692bdc2927 tempest-VolumesSnapshotsTestJSON-851680556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:19:10.001444 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-991f94ab-c90f-41be-844e-aa2f9468bcdb req-9b01ebd1-f61d-485e-9588-83692bdc2927 tempest-VolumesSnapshotsTestJSON-851680556 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:19:10.001638 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-991f94ab-c90f-41be-844e-aa2f9468bcdb req-9b01ebd1-f61d-485e-9588-83692bdc2927 tempest-VolumesSnapshotsTestJSON-851680556 None] Volume volume-4450505c-3ac5-42c2-b94c-b8f945007d50 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:19:10.059857 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-991f94ab-c90f-41be-844e-aa2f9468bcdb req-9b01ebd1-f61d-485e-9588-83692bdc2927 tempest-VolumesSnapshotsTestJSON-851680556 None] deleting rbd volume volume-4450505c-3ac5-42c2-b94c-b8f945007d50 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:19:15.906690 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=26,cinder:UPDATE=8,cinder:DELETE=1,cinder:INSERT=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:19:16.010031 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [req-991f94ab-c90f-41be-844e-aa2f9468bcdb req-9b01ebd1-f61d-485e-9588-83692bdc2927 tempest-VolumesSnapshotsTestJSON-851680556 None] Created reservations ['5bc0816d-a53c-436f-91fc-b1b6110da04e', '280c0834-13bf-458f-a8f1-e55eafbb5eff', 'e3eedf6f-6516-44be-a995-daeec353a8f1', 'e05d0919-8b4e-436c-ab6e-13e5bda9c24e'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:19:16.255328 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-991f94ab-c90f-41be-844e-aa2f9468bcdb req-9b01ebd1-f61d-485e-9588-83692bdc2927 tempest-VolumesSnapshotsTestJSON-851680556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:19:16.323337 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-991f94ab-c90f-41be-844e-aa2f9468bcdb req-9b01ebd1-f61d-485e-9588-83692bdc2927 tempest-VolumesSnapshotsTestJSON-851680556 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:19:16.398221 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [req-991f94ab-c90f-41be-844e-aa2f9468bcdb req-9b01ebd1-f61d-485e-9588-83692bdc2927 tempest-VolumesSnapshotsTestJSON-851680556 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:19:16.408227 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-991f94ab-c90f-41be-844e-aa2f9468bcdb req-9b01ebd1-f61d-485e-9588-83692bdc2927 tempest-VolumesSnapshotsTestJSON-851680556 None] Deleted volume successfully.
Jul 16 21:19:16.539059 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-991f94ab-c90f-41be-844e-aa2f9468bcdb req-9b01ebd1-f61d-485e-9588-83692bdc2927 tempest-VolumesSnapshotsTestJSON-851680556 None] Lock "cinder-4450505c-3ac5-42c2-b94c-b8f945007d50-delete_volume" released by "delete_volume" :: held 7.037s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:19:30.342979 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:19:30.345499 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=42,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:19:34.810121 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:19:34.815929 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:19:34.885968 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:19:34.965631 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:20:00.355055 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:20:10.360081 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:20:22.960080 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:20:22.981300 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Flow 'volume_create_manager' (e9d9c0cf-6ac0-49fa-8a38-53894782c459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:20:22.988019 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857b0551-ee06-4fef-9ead-fdc83a41a152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:20:23.011656 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857b0551-ee06-4fef-9ead-fdc83a41a152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-989658209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d1414df7-4173-492a-ae5f-849dda58e82c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='28489f72346f422f9d44afcf5393acc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:20:23Z,use_quota=True,user_id='9fb89c3c454243dfbb48e3a1971c9491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:20:23.029510 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0bd8d5-ab33-4f08-9a9c-d3ebaba54039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:20:23.029510 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0bd8d5-ab33-4f08-9a9c-d3ebaba54039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:20:23.031827 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e433f9d-657a-494a-bb20-aa5880925b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:20:23.037277 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e433f9d-657a-494a-bb20-aa5880925b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1414df7-4173-492a-ae5f-849dda58e82c', 'volume_name': 'volume-d1414df7-4173-492a-ae5f-849dda58e82c', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:20:23.043099 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b2db85-ea54-4bf3-81f6-13b8a78540d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:20:23.047410 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b2db85-ea54-4bf3-81f6-13b8a78540d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:20:23.053118 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6adff0-0aed-43f0-b88c-f80fb708718b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:20:23.055737 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Volume d1414df7-4173-492a-ae5f-849dda58e82c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1414df7-4173-492a-ae5f-849dda58e82c', 'volume_size': 1}
Jul 16 21:20:23.055737 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] creating volume 'volume-d1414df7-4173-492a-ae5f-849dda58e82c' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:20:23.055737 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:20:24.240061 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:20:24.246127 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:20:24.248030 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6adff0-0aed-43f0-b88c-f80fb708718b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1414df7-4173-492a-ae5f-849dda58e82c', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:20:24.255933 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d094c0-7d3c-4fa2-9991-f995f2470d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:20:24.322077 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Volume volume-d1414df7-4173-492a-ae5f-849dda58e82c (d1414df7-4173-492a-ae5f-849dda58e82c): created successfully
Jul 16 21:20:24.328100 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d094c0-7d3c-4fa2-9991-f995f2470d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:20:24.335019 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Flow 'volume_create_manager' (e9d9c0cf-6ac0-49fa-8a38-53894782c459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:20:24.429344 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-115f8073-eaeb-411b-ac80-a599a415c617 req-3ea293f7-0f04-44d5-af59-925f643ceeee tempest-VolumesGetTestJSON-1435260878 None] Created volume successfully.
Jul 16 21:20:25.480513 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-79f1a657-1f4d-451a-921a-9e90abaf6815 req-79c45a04-c768-480a-bab6-9a57b590ca1e tempest-VolumesGetTestJSON-1435260878 None] Acquiring lock "cinder-d1414df7-4173-492a-ae5f-849dda58e82c-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:20:25.498252 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-79f1a657-1f4d-451a-921a-9e90abaf6815 req-79c45a04-c768-480a-bab6-9a57b590ca1e tempest-VolumesGetTestJSON-1435260878 None] Lock "cinder-d1414df7-4173-492a-ae5f-849dda58e82c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:20:25.675296 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-79f1a657-1f4d-451a-921a-9e90abaf6815 req-79c45a04-c768-480a-bab6-9a57b590ca1e tempest-VolumesGetTestJSON-1435260878 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:20:26.011715 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-79f1a657-1f4d-451a-921a-9e90abaf6815 req-79c45a04-c768-480a-bab6-9a57b590ca1e tempest-VolumesGetTestJSON-1435260878 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:20:26.012151 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-79f1a657-1f4d-451a-921a-9e90abaf6815 req-79c45a04-c768-480a-bab6-9a57b590ca1e tempest-VolumesGetTestJSON-1435260878 None] Volume volume-d1414df7-4173-492a-ae5f-849dda58e82c is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:20:26.120956 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-79f1a657-1f4d-451a-921a-9e90abaf6815 req-79c45a04-c768-480a-bab6-9a57b590ca1e tempest-VolumesGetTestJSON-1435260878 None] deleting rbd volume volume-d1414df7-4173-492a-ae5f-849dda58e82c {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:20:34.496372 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:20:34.694933 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [req-79f1a657-1f4d-451a-921a-9e90abaf6815 req-79c45a04-c768-480a-bab6-9a57b590ca1e tempest-VolumesGetTestJSON-1435260878 None] Created reservations ['0dfa62b7-1e80-480e-b73b-e0b690aec3d3', 'e5394396-c39d-4a48-9ccf-21a0d97fb315', '2ac8ac92-4b70-4c94-bcb0-30477ec24307', 'bfe3669d-59e0-48ac-a653-ad6eee5c0402'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:20:34.815057 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:20:34.816172 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:20:34.952154 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:20:35.164336 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:20:35.399186 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-79f1a657-1f4d-451a-921a-9e90abaf6815 req-79c45a04-c768-480a-bab6-9a57b590ca1e tempest-VolumesGetTestJSON-1435260878 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:20:35.457426 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-79f1a657-1f4d-451a-921a-9e90abaf6815 req-79c45a04-c768-480a-bab6-9a57b590ca1e tempest-VolumesGetTestJSON-1435260878 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:20:35.557695 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [req-79f1a657-1f4d-451a-921a-9e90abaf6815 req-79c45a04-c768-480a-bab6-9a57b590ca1e tempest-VolumesGetTestJSON-1435260878 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:20:35.571059 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-79f1a657-1f4d-451a-921a-9e90abaf6815 req-79c45a04-c768-480a-bab6-9a57b590ca1e tempest-VolumesGetTestJSON-1435260878 None] Deleted volume successfully.
Jul 16 21:20:35.657226 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-79f1a657-1f4d-451a-921a-9e90abaf6815 req-79c45a04-c768-480a-bab6-9a57b590ca1e tempest-VolumesGetTestJSON-1435260878 None] Lock "cinder-d1414df7-4173-492a-ae5f-849dda58e82c-delete_volume" released by "delete_volume" :: held 10.159s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:20:45.578789 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=26,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:21:10.358369 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:21:20.370356 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:21:34.811713 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:21:34.813152 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:21:35.216464 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:21:35.391330 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:21:50.377917 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:22:00.379626 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:22:07.392334 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:22:07.414866 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Flow 'volume_create_manager' (af4d644f-bdc4-4755-9016-91777cdcec8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:22:07.422498 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b9a347-5652-41d5-939c-a8bc0cd03284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:07.443576 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b9a347-5652-41d5-939c-a8bc0cd03284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-820746063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7734c56d-3537-4b9a-b18e-78dda7314333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ca92a86e6c40d59071e58ce4085568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:22:07Z,use_quota=True,user_id='bba77f6ef42547f1aa8480e27868bd4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:07.449742 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95b15c6-b9c6-471f-94ae-952bc1d26d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:07.455712 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95b15c6-b9c6-471f-94ae-952bc1d26d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:07.461209 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c6af36-36cc-4cca-9835-082339b5ee12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:07.466205 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c6af36-36cc-4cca-9835-082339b5ee12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7734c56d-3537-4b9a-b18e-78dda7314333', 'volume_name': 'volume-7734c56d-3537-4b9a-b18e-78dda7314333', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:07.472510 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54cd6254-7bd8-4f37-88a0-1f73a451587e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:07.477380 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54cd6254-7bd8-4f37-88a0-1f73a451587e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:07.482969 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c905c1-23e7-4407-adb4-8462d22990e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:07.484972 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Volume 7734c56d-3537-4b9a-b18e-78dda7314333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7734c56d-3537-4b9a-b18e-78dda7314333', 'volume_size': 1}
Jul 16 21:22:07.485385 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] creating volume 'volume-7734c56d-3537-4b9a-b18e-78dda7314333' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:22:07.486178 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:22:08.790635 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:22:08.791427 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:22:08.799378 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c905c1-23e7-4407-adb4-8462d22990e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7734c56d-3537-4b9a-b18e-78dda7314333', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:08.802569 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296d666a-69d1-4d0e-8caa-4339ab0a3404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:08.945878 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Volume volume-7734c56d-3537-4b9a-b18e-78dda7314333 (7734c56d-3537-4b9a-b18e-78dda7314333): created successfully
Jul 16 21:22:08.949523 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296d666a-69d1-4d0e-8caa-4339ab0a3404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:08.956208 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Flow 'volume_create_manager' (af4d644f-bdc4-4755-9016-91777cdcec8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:22:09.060829 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-76a141ad-d7e8-4303-bf4f-c12c91793b2e tempest-AttachVolumeTestJSON-1168541016 None] Created volume successfully.
Jul 16 21:22:10.535709 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-f0042231-4d26-484c-a73a-4ffb4bd992cc req-8fa23bff-b51c-4ae7-b014-56b2ccb9d222 tempest-AttachVolumeTestJSON-1168541016 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:22:12.178905 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-f0042231-4d26-484c-a73a-4ffb4bd992cc req-8fa23bff-b51c-4ae7-b014-56b2ccb9d222 tempest-AttachVolumeTestJSON-1168541016 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.643s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:22:12.180478 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-f0042231-4d26-484c-a73a-4ffb4bd992cc req-8fa23bff-b51c-4ae7-b014-56b2ccb9d222 tempest-AttachVolumeTestJSON-1168541016 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7734c56d-3537-4b9a-b18e-78dda7314333', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '7734c56d-3537-4b9a-b18e-78dda7314333', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:22:12.311651 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-f0042231-4d26-484c-a73a-4ffb4bd992cc req-8fa23bff-b51c-4ae7-b014-56b2ccb9d222 tempest-AttachVolumeTestJSON-1168541016 None] Connection info returned from driver {'name': 'volumes/volume-7734c56d-3537-4b9a-b18e-78dda7314333', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7734c56d-3537-4b9a-b18e-78dda7314333', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7abefa8f-b00a-4eb5-a485-81bfb1d2d67c'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:22:12.479022 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-f0042231-4d26-484c-a73a-4ffb4bd992cc req-8fa23bff-b51c-4ae7-b014-56b2ccb9d222 tempest-AttachVolumeTestJSON-1168541016 None] attachment_update completed successfully.
Jul 16 21:22:30.381711 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=24,cinder:UPDATE=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:22:34.810175 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:22:34.812377 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:22:34.854460 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:22:34.885950 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:22:40.381144 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=18,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:22:40.586289 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:22:40.617405 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Flow 'volume_create_manager' (8ce18f0e-dc0d-4553-9f27-ea535bb9c4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:22:40.640362 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38942cae-2974-4976-8fbd-26c41de34b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:40.661044 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38942cae-2974-4976-8fbd-26c41de34b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-948713078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=71861a5b-1ca1-4935-9349-fbb30a4fc8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31be8475a6a49d6bfe8132dd050c6c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:22:40Z,use_quota=True,user_id='6f2e974ab5aa48dfb4b00f810dcedb63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:40.666789 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee389ad5-1bed-4f8a-9cce-88bd092341a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:40.671050 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee389ad5-1bed-4f8a-9cce-88bd092341a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:40.677002 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e679e7b-4c94-41c7-a476-bbac5bcf4cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:40.682398 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e679e7b-4c94-41c7-a476-bbac5bcf4cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71861a5b-1ca1-4935-9349-fbb30a4fc8bc', 'volume_name': 'volume-71861a5b-1ca1-4935-9349-fbb30a4fc8bc', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:40.688208 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe231840-944c-41f1-8f3b-d275768d30c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:40.692911 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe231840-944c-41f1-8f3b-d275768d30c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:40.698526 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28728d5-7039-4398-aef8-339395e2ee26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:40.700432 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Volume 71861a5b-1ca1-4935-9349-fbb30a4fc8bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71861a5b-1ca1-4935-9349-fbb30a4fc8bc', 'volume_size': 1}
Jul 16 21:22:40.701212 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] creating volume 'volume-71861a5b-1ca1-4935-9349-fbb30a4fc8bc' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:22:40.703384 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:22:41.790770 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:22:41.791329 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:22:41.795203 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28728d5-7039-4398-aef8-339395e2ee26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71861a5b-1ca1-4935-9349-fbb30a4fc8bc', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:41.803826 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf7089e-55ae-4278-a770-ba6fea71822b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:41.905529 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Volume volume-71861a5b-1ca1-4935-9349-fbb30a4fc8bc (71861a5b-1ca1-4935-9349-fbb30a4fc8bc): created successfully
Jul 16 21:22:41.911621 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf7089e-55ae-4278-a770-ba6fea71822b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:41.921239 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Flow 'volume_create_manager' (8ce18f0e-dc0d-4553-9f27-ea535bb9c4ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:22:42.040856 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-afbbf8c7-23e3-4339-8214-dfb0aab437e7 tempest-DeleteServersTestJSON-1541892181 None] Created volume successfully.
Jul 16 21:22:43.785098 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-5f21b11d-0e59-4209-be52-c5280c5d8111 req-8ad5c71e-a384-409d-a941-26295347923f tempest-DeleteServersTestJSON-1541892181 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:22:44.879389 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-5f21b11d-0e59-4209-be52-c5280c5d8111 req-8ad5c71e-a384-409d-a941-26295347923f tempest-DeleteServersTestJSON-1541892181 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.094s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:22:44.880312 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-5f21b11d-0e59-4209-be52-c5280c5d8111 req-8ad5c71e-a384-409d-a941-26295347923f tempest-DeleteServersTestJSON-1541892181 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-71861a5b-1ca1-4935-9349-fbb30a4fc8bc', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '71861a5b-1ca1-4935-9349-fbb30a4fc8bc', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:22:45.010618 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-5f21b11d-0e59-4209-be52-c5280c5d8111 req-8ad5c71e-a384-409d-a941-26295347923f tempest-DeleteServersTestJSON-1541892181 None] Connection info returned from driver {'name': 'volumes/volume-71861a5b-1ca1-4935-9349-fbb30a4fc8bc', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '71861a5b-1ca1-4935-9349-fbb30a4fc8bc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '51bab9b8-6100-473d-ae0d-729b46e21a23'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:22:45.206768 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-5f21b11d-0e59-4209-be52-c5280c5d8111 req-8ad5c71e-a384-409d-a941-26295347923f tempest-DeleteServersTestJSON-1541892181 None] attachment_update completed successfully.
Jul 16 21:22:50.708963 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:22:50.728485 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Flow 'volume_create_manager' (d3f74df5-7759-4262-9f46-21e9912d8383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:22:50.736608 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3737c0-862b-4952-a7ad-11459216155b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:50.758392 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3737c0-862b-4952-a7ad-11459216155b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-283092069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f4c1e544-bdaf-4a33-bf91-08a306e68029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1f6ffc3fb64dba8c4474641e796fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:22:50Z,use_quota=True,user_id='029f1334779e4bcdb3f4f2aed564a075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:50.763934 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d283707-92c8-4052-8a58-c5c4aa049fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:50.768726 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d283707-92c8-4052-8a58-c5c4aa049fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:50.774280 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b944b7-02c5-41bf-b26d-8b5e4b2d04eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:50.780076 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b944b7-02c5-41bf-b26d-8b5e4b2d04eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c1e544-bdaf-4a33-bf91-08a306e68029', 'volume_name': 'volume-f4c1e544-bdaf-4a33-bf91-08a306e68029', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:50.784529 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2af41de-e1ae-4968-af87-5187dfb6e537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:50.791767 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2af41de-e1ae-4968-af87-5187dfb6e537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:50.798140 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (791ca7f8-eeae-43df-a5e9-921edb1921c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:50.799584 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Volume f4c1e544-bdaf-4a33-bf91-08a306e68029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c1e544-bdaf-4a33-bf91-08a306e68029', 'volume_size': 1}
Jul 16 21:22:50.800245 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] creating volume 'volume-f4c1e544-bdaf-4a33-bf91-08a306e68029' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:22:50.801254 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:22:51.901972 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:22:51.902619 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:22:51.906512 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (791ca7f8-eeae-43df-a5e9-921edb1921c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c1e544-bdaf-4a33-bf91-08a306e68029', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:51.912834 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d9ba4e-ce44-458e-8395-d0d6ff0c6f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:22:51.971899 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Volume volume-f4c1e544-bdaf-4a33-bf91-08a306e68029 (f4c1e544-bdaf-4a33-bf91-08a306e68029): created successfully
Jul 16 21:22:51.976717 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d9ba4e-ce44-458e-8395-d0d6ff0c6f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:22:51.987971 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Flow 'volume_create_manager' (d3f74df5-7759-4262-9f46-21e9912d8383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:22:52.097890 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-54c0346e-2b94-4c42-9fd1-f7b4e229e5aa tempest-AttachSCSIVolumeTestJSON-288658511 None] Created volume successfully.
Jul 16 21:22:53.142268 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-85997114-1240-4d1e-93f4-454bd7980f44 req-d966fd5e-15ee-4dda-8d69-1d4015f27df0 tempest-DeleteServersTestJSON-1541892181 None] Terminate volume connection completed successfully.
Jul 16 21:22:53.142825 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-85997114-1240-4d1e-93f4-454bd7980f44 req-d966fd5e-15ee-4dda-8d69-1d4015f27df0 tempest-DeleteServersTestJSON-1541892181 None] Deleting attachment 51bab9b8-6100-473d-ae0d-729b46e21a23. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:22:53.885803 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-214c551d-1d2b-4a9d-a648-096564251b2f req-c125cc7c-fab4-4fda-9fe5-428847805a46 tempest-AttachSCSIVolumeTestJSON-288658511 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:22:55.089139 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-214c551d-1d2b-4a9d-a648-096564251b2f req-c125cc7c-fab4-4fda-9fe5-428847805a46 tempest-AttachSCSIVolumeTestJSON-288658511 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.203s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:22:55.089986 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-214c551d-1d2b-4a9d-a648-096564251b2f req-c125cc7c-fab4-4fda-9fe5-428847805a46 tempest-AttachSCSIVolumeTestJSON-288658511 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f4c1e544-bdaf-4a33-bf91-08a306e68029', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'f4c1e544-bdaf-4a33-bf91-08a306e68029', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:22:55.201770 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-214c551d-1d2b-4a9d-a648-096564251b2f req-c125cc7c-fab4-4fda-9fe5-428847805a46 tempest-AttachSCSIVolumeTestJSON-288658511 None] Connection info returned from driver {'name': 'volumes/volume-f4c1e544-bdaf-4a33-bf91-08a306e68029', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f4c1e544-bdaf-4a33-bf91-08a306e68029', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'cc1e4992-39c3-44c6-8459-85e1a046d07d'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:22:55.436165 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-214c551d-1d2b-4a9d-a648-096564251b2f req-c125cc7c-fab4-4fda-9fe5-428847805a46 tempest-AttachSCSIVolumeTestJSON-288658511 None] attachment_update completed successfully.
Jul 16 21:23:00.228029 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-d29dc8ae-21c5-45e8-9d16-045ca100e701 req-222b06a7-f79c-476f-a98f-3dcb9bbd5a82 tempest-AttachSCSIVolumeTestJSON-288658511 None] Terminate volume connection completed successfully.
Jul 16 21:23:00.234481 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-d29dc8ae-21c5-45e8-9d16-045ca100e701 req-222b06a7-f79c-476f-a98f-3dcb9bbd5a82 tempest-AttachSCSIVolumeTestJSON-288658511 None] Deleting attachment cc1e4992-39c3-44c6-8459-85e1a046d07d. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:23:10.265070 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=43,cinder:UPDATE=9,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:23:10.266452 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-a877d8eb-dd69-4996-b614-6699a1744fb7 req-fe05a06f-7640-4348-87cf-07389881fbf9 tempest-AttachVolumeTestJSON-1168541016 None] Terminate volume connection completed successfully.
Jul 16 21:23:10.266865 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-a877d8eb-dd69-4996-b614-6699a1744fb7 req-fe05a06f-7640-4348-87cf-07389881fbf9 tempest-AttachVolumeTestJSON-1168541016 None] Deleting attachment 7abefa8f-b00a-4eb5-a485-81bfb1d2d67c. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:23:16.264961 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8fbe3a1c-462b-4cb0-a969-992e7ad23248 tempest-AttachSCSIVolumeTestJSON-288658511 None] Acquiring lock "cinder-f4c1e544-bdaf-4a33-bf91-08a306e68029-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:23:16.290360 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8fbe3a1c-462b-4cb0-a969-992e7ad23248 tempest-AttachSCSIVolumeTestJSON-288658511 None] Lock "cinder-f4c1e544-bdaf-4a33-bf91-08a306e68029-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:23:16.472547 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=39,cinder:UPDATE=7 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:23:16.486460 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8fbe3a1c-462b-4cb0-a969-992e7ad23248 tempest-AttachSCSIVolumeTestJSON-288658511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:23:16.756491 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8fbe3a1c-462b-4cb0-a969-992e7ad23248 tempest-AttachSCSIVolumeTestJSON-288658511 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:23:16.757526 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8fbe3a1c-462b-4cb0-a969-992e7ad23248 tempest-AttachSCSIVolumeTestJSON-288658511 None] Volume volume-f4c1e544-bdaf-4a33-bf91-08a306e68029 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:23:16.890719 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8fbe3a1c-462b-4cb0-a969-992e7ad23248 tempest-AttachSCSIVolumeTestJSON-288658511 None] deleting rbd volume volume-f4c1e544-bdaf-4a33-bf91-08a306e68029 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:23:21.590989 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-ea772e38-84a6-47d2-bc52-894511c8c31e req-38502b63-27bc-4252-aca8-6eaf3cd1c014 tempest-ServersTestBootFromVolume-1080567873 None] Terminate volume connection completed successfully.
Jul 16 21:23:21.593106 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-ea772e38-84a6-47d2-bc52-894511c8c31e req-38502b63-27bc-4252-aca8-6eaf3cd1c014 tempest-ServersTestBootFromVolume-1080567873 None] Deleting attachment bd0c98c2-19ec-4cce-8e61-c086d28da019. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:23:22.226752 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-ea772e38-84a6-47d2-bc52-894511c8c31e req-23ce0ac9-0c0e-4c42-be95-e2a279b44c17 tempest-ServersTestBootFromVolume-1080567873 None] Acquiring lock "cinder-7fa5082b-070c-4f64-9f0b-f24264ffca4a-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:23:22.241207 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-ea772e38-84a6-47d2-bc52-894511c8c31e req-23ce0ac9-0c0e-4c42-be95-e2a279b44c17 tempest-ServersTestBootFromVolume-1080567873 None] Lock "cinder-7fa5082b-070c-4f64-9f0b-f24264ffca4a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:23:22.419252 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-ea772e38-84a6-47d2-bc52-894511c8c31e req-23ce0ac9-0c0e-4c42-be95-e2a279b44c17 tempest-ServersTestBootFromVolume-1080567873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:23:22.778009 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-ea772e38-84a6-47d2-bc52-894511c8c31e req-23ce0ac9-0c0e-4c42-be95-e2a279b44c17 tempest-ServersTestBootFromVolume-1080567873 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:23:23.008382 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-ea772e38-84a6-47d2-bc52-894511c8c31e req-23ce0ac9-0c0e-4c42-be95-e2a279b44c17 tempest-ServersTestBootFromVolume-1080567873 None] deleting rbd volume volume-7fa5082b-070c-4f64-9f0b-f24264ffca4a {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:23:25.069433 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-8fbe3a1c-462b-4cb0-a969-992e7ad23248 tempest-AttachSCSIVolumeTestJSON-288658511 None] Created reservations ['f274a9e3-a1e5-460a-b059-105ac772f3de', '9f58d8e3-c224-4a0c-925f-7f52625002ba', '4d553e97-2629-4e17-8f74-b70eb850ca1e', '24af6ede-028b-4e44-99bb-168959c442da'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:23:25.333872 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8fbe3a1c-462b-4cb0-a969-992e7ad23248 tempest-AttachSCSIVolumeTestJSON-288658511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:23:25.432872 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8fbe3a1c-462b-4cb0-a969-992e7ad23248 tempest-AttachSCSIVolumeTestJSON-288658511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:23:25.641816 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-8fbe3a1c-462b-4cb0-a969-992e7ad23248 tempest-AttachSCSIVolumeTestJSON-288658511 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:23:25.657802 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-8fbe3a1c-462b-4cb0-a969-992e7ad23248 tempest-AttachSCSIVolumeTestJSON-288658511 None] Deleted volume successfully.
Jul 16 21:23:25.770572 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8fbe3a1c-462b-4cb0-a969-992e7ad23248 tempest-AttachSCSIVolumeTestJSON-288658511 None] Lock "cinder-f4c1e544-bdaf-4a33-bf91-08a306e68029-delete_volume" released by "delete_volume" :: held 9.481s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:23:32.244066 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-ea772e38-84a6-47d2-bc52-894511c8c31e req-23ce0ac9-0c0e-4c42-be95-e2a279b44c17 tempest-ServersTestBootFromVolume-1080567873 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:23:32.379167 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-ea772e38-84a6-47d2-bc52-894511c8c31e req-23ce0ac9-0c0e-4c42-be95-e2a279b44c17 tempest-ServersTestBootFromVolume-1080567873 None] deleting parent snapshot volume-7fa5082b-070c-4f64-9f0b-f24264ffca4a.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:23:35.384426 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:23:35.387248 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:23:35.426894 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:23:35.457749 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:23:35.595427 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [req-ea772e38-84a6-47d2-bc52-894511c8c31e req-23ce0ac9-0c0e-4c42-be95-e2a279b44c17 tempest-ServersTestBootFromVolume-1080567873 None] Created reservations ['cb23bc7c-b024-420f-a26b-42561263c67d', '91eb4a19-3bec-456c-8ce9-38366ccc4e55', 'e5c42f01-7688-4820-b504-71cd6f7bb339', '5844e713-aeff-4e9b-b46d-b271fe330655'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:23:35.846720 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-ea772e38-84a6-47d2-bc52-894511c8c31e req-23ce0ac9-0c0e-4c42-be95-e2a279b44c17 tempest-ServersTestBootFromVolume-1080567873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:23:35.947204 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-ea772e38-84a6-47d2-bc52-894511c8c31e req-23ce0ac9-0c0e-4c42-be95-e2a279b44c17 tempest-ServersTestBootFromVolume-1080567873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:23:35.997594 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [req-ea772e38-84a6-47d2-bc52-894511c8c31e req-23ce0ac9-0c0e-4c42-be95-e2a279b44c17 tempest-ServersTestBootFromVolume-1080567873 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:23:36.006491 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-ea772e38-84a6-47d2-bc52-894511c8c31e req-23ce0ac9-0c0e-4c42-be95-e2a279b44c17 tempest-ServersTestBootFromVolume-1080567873 None] Deleted volume successfully.
Jul 16 21:23:36.147845 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-ea772e38-84a6-47d2-bc52-894511c8c31e req-23ce0ac9-0c0e-4c42-be95-e2a279b44c17 tempest-ServersTestBootFromVolume-1080567873 None] Lock "cinder-7fa5082b-070c-4f64-9f0b-f24264ffca4a-delete_volume" released by "delete_volume" :: held 13.907s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:23:50.407593 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=26,cinder:UPDATE=9,cinder:INSERT=4,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:23:50.408557 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=35,cinder:UPDATE=26,cinder:INSERT=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:24:10.405549 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:24:18.818214 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:24:18.865727 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Flow 'volume_create_manager' (2831dfe2-8490-4bc2-a1f8-cdacf32e9012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:24:18.888753 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef3640a-0e9c-4d3d-8a94-840b6d92ea9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:18.929079 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef3640a-0e9c-4d3d-8a94-840b6d92ea9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-994787098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6c632192-292e-476a-92f7-a3a26a1725e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc2e42a0df346f4adef152ba2e3fa71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:24:19Z,use_quota=True,user_id='a23fafbab18d41ee82b84bbdf94cf0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:18.941503 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc8070d-b932-4d17-8b19-c2d7a527c147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:18.955416 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc8070d-b932-4d17-8b19-c2d7a527c147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:18.967363 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fa774d-15e0-445a-891d-2fc41ec0d381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:19.132837 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fa774d-15e0-445a-891d-2fc41ec0d381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c632192-292e-476a-92f7-a3a26a1725e6', 'volume_name': 'volume-6c632192-292e-476a-92f7-a3a26a1725e6', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f7dbd00>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:19.141844 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7407207e-a930-4004-be7d-c33323620cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:19.161294 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7407207e-a930-4004-be7d-c33323620cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:19.168139 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282e0990-a9d5-4f81-87c3-e6620cb7dca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:19.171526 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Volume 6c632192-292e-476a-92f7-a3a26a1725e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c632192-292e-476a-92f7-a3a26a1725e6', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f7dbd00>}
Jul 16 21:24:19.172395 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Cloning 6c632192-292e-476a-92f7-a3a26a1725e6 from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9  at location (None, None). {{(pid=131857) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Jul 16 21:24:19.177288 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Acquiring lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" by "_prepare_image_cache_entry" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:24:19.189026 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:24:19.301600 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 24, 19, 205070)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:24:19.302040 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:24:19.302453 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Found cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Jul 16 21:24:19.307131 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" released by "_prepare_image_cache_entry" :: held 0.118s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:24:19.308387 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Attempting to retrieve cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Jul 16 21:24:19.320986 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 24, 19, 316163)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:24:19.321412 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:24:19.321812 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Creating from source image-volume b59b3901-b32a-4d92-81b0-6b99e88e4517 {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Jul 16 21:24:19.370003 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:24:19.707566 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] creating snapshot='volume-6c632192-292e-476a-92f7-a3a26a1725e6.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:24:21.343447 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] cloning 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517@volume-6c632192-292e-476a-92f7-a3a26a1725e6.clone_snap' to 'volume-6c632192-292e-476a-92f7-a3a26a1725e6' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:24:22.517257 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945.deleted is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:24:22.519439 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:24:22.520148 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:24:22.848981 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:24:22.849944 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Marking volume 6c632192-292e-476a-92f7-a3a26a1725e6 as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:24:22.854629 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=16,cinder:UPDATE=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:24:22.975554 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Copying metadata from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 to 6c632192-292e-476a-92f7-a3a26a1725e6. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Jul 16 21:24:22.976798 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Creating volume glance metadata for volume 6c632192-292e-476a-92f7-a3a26a1725e6 backed by image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131857) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Jul 16 21:24:23.116164 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282e0990-a9d5-4f81-87c3-e6620cb7dca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c632192-292e-476a-92f7-a3a26a1725e6', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f7dbd00>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:23.129475 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbb5b19-4f7c-4714-ae25-a4f79bc200d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:23.251132 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Volume volume-6c632192-292e-476a-92f7-a3a26a1725e6 (6c632192-292e-476a-92f7-a3a26a1725e6): created successfully
Jul 16 21:24:23.256136 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbb5b19-4f7c-4714-ae25-a4f79bc200d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:23.265788 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Flow 'volume_create_manager' (2831dfe2-8490-4bc2-a1f8-cdacf32e9012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:24:23.342081 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-37e61170-9356-4cea-a864-fc9c35a7af37 tempest-TaggedBootDevicesTest-1806311997 None] Created volume successfully.
Jul 16 21:24:25.167214 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:24:25.187882 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Flow 'volume_create_manager' (790c56df-f9a6-45f2-80fb-791ced81b370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:24:25.194120 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385b51da-4861-463e-8777-f654e68b79ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:25.223292 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385b51da-4861-463e-8777-f654e68b79ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1474289554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=83999d90-80b2-4c0c-8aff-bec74809b4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc2e42a0df346f4adef152ba2e3fa71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:24:25Z,use_quota=True,user_id='a23fafbab18d41ee82b84bbdf94cf0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:25.235771 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7947a561-78d6-4eb1-a492-496b1f3adea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:25.236033 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7947a561-78d6-4eb1-a492-496b1f3adea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:25.241954 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97d18a8-8196-48ff-8a56-fd9137f657ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:25.247467 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97d18a8-8196-48ff-8a56-fd9137f657ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83999d90-80b2-4c0c-8aff-bec74809b4d9', 'volume_name': 'volume-83999d90-80b2-4c0c-8aff-bec74809b4d9', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:25.255754 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cba76c-e2a6-4272-8eff-ddb7a14fe475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:25.258954 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cba76c-e2a6-4272-8eff-ddb7a14fe475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:25.283139 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de7e25c-9c7f-4e7e-a36c-4ad7ccbafa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:25.286301 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Volume 83999d90-80b2-4c0c-8aff-bec74809b4d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83999d90-80b2-4c0c-8aff-bec74809b4d9', 'volume_size': 1}
Jul 16 21:24:25.286838 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] creating volume 'volume-83999d90-80b2-4c0c-8aff-bec74809b4d9' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:24:25.288760 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:24:26.116489 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:24:26.117324 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:24:26.138031 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de7e25c-9c7f-4e7e-a36c-4ad7ccbafa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83999d90-80b2-4c0c-8aff-bec74809b4d9', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:26.145293 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b05038-76cd-436e-b232-466b936bfed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:26.272532 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Volume volume-83999d90-80b2-4c0c-8aff-bec74809b4d9 (83999d90-80b2-4c0c-8aff-bec74809b4d9): created successfully
Jul 16 21:24:26.282825 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b05038-76cd-436e-b232-466b936bfed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:26.294070 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Flow 'volume_create_manager' (790c56df-f9a6-45f2-80fb-791ced81b370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:24:26.410307 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-63a878cb-429b-4d43-b9e6-962973b3d414 tempest-TaggedBootDevicesTest-1806311997 None] Created volume successfully.
Jul 16 21:24:28.195189 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:24:28.241423 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Flow 'volume_create_manager' (b5f5132e-8ea5-4f87-987d-23a301c5ae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:24:28.254368 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30780621-b038-4ece-a190-04c2d8f4a153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:28.287624 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30780621-b038-4ece-a190-04c2d8f4a153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-639905850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f0883a5a-4e31-4e72-9db6-7d56ee50023e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc2e42a0df346f4adef152ba2e3fa71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:24:28Z,use_quota=True,user_id='a23fafbab18d41ee82b84bbdf94cf0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:28.324732 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca0ebc9-0a74-4190-8eac-fd51b2f41a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:28.340206 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca0ebc9-0a74-4190-8eac-fd51b2f41a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:28.359824 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5dfc39-1303-42ec-bd23-abfafb41d749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:28.364127 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5dfc39-1303-42ec-bd23-abfafb41d749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0883a5a-4e31-4e72-9db6-7d56ee50023e', 'volume_name': 'volume-f0883a5a-4e31-4e72-9db6-7d56ee50023e', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:28.385506 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57e21d0-d169-4270-83ed-45c7ee6c06cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:28.409152 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57e21d0-d169-4270-83ed-45c7ee6c06cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:28.415223 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4ab8a2-860f-433e-bd1a-0c92420816a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:28.416669 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Volume f0883a5a-4e31-4e72-9db6-7d56ee50023e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0883a5a-4e31-4e72-9db6-7d56ee50023e', 'volume_size': 1}
Jul 16 21:24:28.417260 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] creating volume 'volume-f0883a5a-4e31-4e72-9db6-7d56ee50023e' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:24:28.417927 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:24:28.966584 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:24:28.967268 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:24:28.971321 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4ab8a2-860f-433e-bd1a-0c92420816a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0883a5a-4e31-4e72-9db6-7d56ee50023e', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:28.993865 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee49791-5c44-4b86-8b49-2a543e86d640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:29.095558 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Volume volume-f0883a5a-4e31-4e72-9db6-7d56ee50023e (f0883a5a-4e31-4e72-9db6-7d56ee50023e): created successfully
Jul 16 21:24:29.100327 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee49791-5c44-4b86-8b49-2a543e86d640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:29.108963 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Flow 'volume_create_manager' (b5f5132e-8ea5-4f87-987d-23a301c5ae38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:24:29.198961 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-0b3de355-5936-4ebd-ade8-a6c269fbd3ef tempest-TaggedBootDevicesTest-1806311997 None] Created volume successfully.
Jul 16 21:24:35.388515 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:24:35.390584 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:24:35.543806 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:24:35.673934 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:24:39.115208 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:24:41.357252 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=35,cinder:UPDATE=7,cinder:INSERT=12,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:24:46.316171 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:24:46.357815 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Flow 'volume_create_manager' (6c57c6b5-9519-4bf3-a9f5-71cb8bcfe1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:24:46.372741 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a32155-dbc9-42f6-9953-5c944b7aca32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:46.405921 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a32155-dbc9-42f6-9953-5c944b7aca32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-685062551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2ad5c999-dbbb-4a76-b49d-712201be83a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcafa6d06a74473f91cbc3322e711f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:24:46Z,use_quota=True,user_id='e1fe9c36813b4eaabc25578f20a62b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:46.413194 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382f1336-e4d1-4350-b87d-e3e9a4405ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:46.424066 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382f1336-e4d1-4350-b87d-e3e9a4405ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:46.428518 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d61e219-7431-4d0f-a911-6a982159db56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:46.433887 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d61e219-7431-4d0f-a911-6a982159db56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ad5c999-dbbb-4a76-b49d-712201be83a6', 'volume_name': 'volume-2ad5c999-dbbb-4a76-b49d-712201be83a6', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:46.439820 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca474a83-b2c1-4f91-b56d-3c124bbe2bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:46.445327 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca474a83-b2c1-4f91-b56d-3c124bbe2bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:46.450931 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876d2d68-3d36-49f4-b76b-a367f44335f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:46.452322 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Volume 2ad5c999-dbbb-4a76-b49d-712201be83a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ad5c999-dbbb-4a76-b49d-712201be83a6', 'volume_size': 1}
Jul 16 21:24:46.452902 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] creating volume 'volume-2ad5c999-dbbb-4a76-b49d-712201be83a6' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:24:46.456429 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:24:47.110181 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:24:47.110561 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:24:47.114930 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876d2d68-3d36-49f4-b76b-a367f44335f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ad5c999-dbbb-4a76-b49d-712201be83a6', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:47.124368 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5015b1-0c26-426b-ace2-786fadba2c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:47.203932 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Volume volume-2ad5c999-dbbb-4a76-b49d-712201be83a6 (2ad5c999-dbbb-4a76-b49d-712201be83a6): created successfully
Jul 16 21:24:47.208633 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5015b1-0c26-426b-ace2-786fadba2c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:47.217804 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Flow 'volume_create_manager' (6c57c6b5-9519-4bf3-a9f5-71cb8bcfe1b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:24:47.294854 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-869bfa62-b260-498c-9560-080b670fef95 tempest-VolumeQuotasNegativeTestJSON-932454938 None] Created volume successfully.
Jul 16 21:24:50.828118 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-eb1fabd9-6aed-4eda-9727-8b761d6b98ea tempest-VolumeQuotasNegativeTestJSON-932454938 None] Acquiring lock "cinder-2ad5c999-dbbb-4a76-b49d-712201be83a6-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:24:50.848628 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-eb1fabd9-6aed-4eda-9727-8b761d6b98ea tempest-VolumeQuotasNegativeTestJSON-932454938 None] Lock "cinder-2ad5c999-dbbb-4a76-b49d-712201be83a6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:24:51.051763 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-eb1fabd9-6aed-4eda-9727-8b761d6b98ea tempest-VolumeQuotasNegativeTestJSON-932454938 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:24:51.364985 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-eb1fabd9-6aed-4eda-9727-8b761d6b98ea tempest-VolumeQuotasNegativeTestJSON-932454938 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:24:51.371920 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-eb1fabd9-6aed-4eda-9727-8b761d6b98ea tempest-VolumeQuotasNegativeTestJSON-932454938 None] Volume volume-2ad5c999-dbbb-4a76-b49d-712201be83a6 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:24:51.558485 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-eb1fabd9-6aed-4eda-9727-8b761d6b98ea tempest-VolumeQuotasNegativeTestJSON-932454938 None] deleting rbd volume volume-2ad5c999-dbbb-4a76-b49d-712201be83a6 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:24:55.272426 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-eb1fabd9-6aed-4eda-9727-8b761d6b98ea tempest-VolumeQuotasNegativeTestJSON-932454938 None] Created reservations ['9c7a52f7-b2de-46f7-973a-1955108e6470', 'd89be4c4-8ec7-4d29-839e-3ceb016318f6', 'c7c8a41d-a9b8-458f-9faf-bc090ba856df', 'e28aecc9-c00c-4180-87de-5924c0bd1be5'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:24:55.555861 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-eb1fabd9-6aed-4eda-9727-8b761d6b98ea tempest-VolumeQuotasNegativeTestJSON-932454938 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:24:55.638737 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-eb1fabd9-6aed-4eda-9727-8b761d6b98ea tempest-VolumeQuotasNegativeTestJSON-932454938 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:24:55.700120 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-eb1fabd9-6aed-4eda-9727-8b761d6b98ea tempest-VolumeQuotasNegativeTestJSON-932454938 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:24:55.714255 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-eb1fabd9-6aed-4eda-9727-8b761d6b98ea tempest-VolumeQuotasNegativeTestJSON-932454938 None] Deleted volume successfully.
Jul 16 21:24:55.795602 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-eb1fabd9-6aed-4eda-9727-8b761d6b98ea tempest-VolumeQuotasNegativeTestJSON-932454938 None] Lock "cinder-2ad5c999-dbbb-4a76-b49d-712201be83a6-delete_volume" released by "delete_volume" :: held 4.950s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:24:56.957331 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:24:56.998400 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Flow 'volume_create_manager' (8845145e-b532-4171-a201-f50f1f320652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:24:57.014276 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0b4dea-e287-4c93-b229-7131fdc0f311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:57.053607 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0b4dea-e287-4c93-b229-7131fdc0f311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-840411257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=48e72420-c2e0-466c-8349-298ea1959ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da56fc78f06142aba80ca4c6e3d60475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:24:57Z,use_quota=True,user_id='bcc9aa2a091c490599f9a9c41163e2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:57.065954 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ac528f-6cd5-4af8-a1df-c712f25091f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:57.076648 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ac528f-6cd5-4af8-a1df-c712f25091f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:57.099020 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b81bb6-6496-489f-98aa-a144726c7387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:57.104015 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b81bb6-6496-489f-98aa-a144726c7387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e72420-c2e0-466c-8349-298ea1959ee1', 'volume_name': 'volume-48e72420-c2e0-466c-8349-298ea1959ee1', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:57.109105 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6d420c-f54b-4708-adc5-6e8427ffafdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:57.113099 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6d420c-f54b-4708-adc5-6e8427ffafdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:57.118837 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb93a53-ec3b-4a14-b43e-1c68af155ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:57.120092 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Volume 48e72420-c2e0-466c-8349-298ea1959ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e72420-c2e0-466c-8349-298ea1959ee1', 'volume_size': 1}
Jul 16 21:24:57.120549 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] creating volume 'volume-48e72420-c2e0-466c-8349-298ea1959ee1' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:24:57.121333 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:24:57.914402 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:24:57.915110 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:24:57.921354 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb93a53-ec3b-4a14-b43e-1c68af155ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e72420-c2e0-466c-8349-298ea1959ee1', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:57.928324 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad3265e-ad3b-4d93-97a0-aeb1f0d8263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:24:58.026306 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Volume volume-48e72420-c2e0-466c-8349-298ea1959ee1 (48e72420-c2e0-466c-8349-298ea1959ee1): created successfully
Jul 16 21:24:58.030249 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad3265e-ad3b-4d93-97a0-aeb1f0d8263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:24:58.039364 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Flow 'volume_create_manager' (8845145e-b532-4171-a201-f50f1f320652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:24:58.170045 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-6dfd3e6f-569e-454d-8aa2-5f5c92e4423c tempest-ServerRescueNegativeTestJSON-439221844 None] Created volume successfully.
Jul 16 21:25:05.803503 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-c6df4a88-bc09-479f-b0cf-d5e47766b27f req-7d3da7b4-8102-41da-982b-c0bf29515303 tempest-TaggedBootDevicesTest-1806311997 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:25:07.161559 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-c6df4a88-bc09-479f-b0cf-d5e47766b27f req-7d3da7b4-8102-41da-982b-c0bf29515303 tempest-TaggedBootDevicesTest-1806311997 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.358s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:25:07.162245 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-c6df4a88-bc09-479f-b0cf-d5e47766b27f req-7d3da7b4-8102-41da-982b-c0bf29515303 tempest-TaggedBootDevicesTest-1806311997 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6c632192-292e-476a-92f7-a3a26a1725e6', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '6c632192-292e-476a-92f7-a3a26a1725e6', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:25:07.234328 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:25:07.271211 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Flow 'volume_create_manager' (f10b2d27-0e2d-434c-9d94-4b61e89981ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:25:07.279686 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1e6933-65cb-4e38-9813-afd2768e5cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:07.301548 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1e6933-65cb-4e38-9813-afd2768e5cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-668248996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=92070518-dcce-43bf-9913-675ce13d6a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db405b7acaa14a18b71529d9d0710c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:25:07Z,use_quota=True,user_id='0aef6cf4bba04285808fb348ecfefd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:07.309164 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6709e9ac-5057-4001-879b-48b93b1f2288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:07.314370 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6709e9ac-5057-4001-879b-48b93b1f2288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:07.335439 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5cc454-b30d-466c-b316-57c14b1bc673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:07.340164 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5cc454-b30d-466c-b316-57c14b1bc673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92070518-dcce-43bf-9913-675ce13d6a6d', 'volume_name': 'volume-92070518-dcce-43bf-9913-675ce13d6a6d', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:07.347874 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9bf231-7b47-406e-a5b8-bc556ac83557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:07.352712 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9bf231-7b47-406e-a5b8-bc556ac83557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:07.363335 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ee2dbc-aaf7-43fa-85c7-7b3d0bc55468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:07.364630 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Volume 92070518-dcce-43bf-9913-675ce13d6a6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92070518-dcce-43bf-9913-675ce13d6a6d', 'volume_size': 1}
Jul 16 21:25:07.365206 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] creating volume 'volume-92070518-dcce-43bf-9913-675ce13d6a6d' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:25:07.366547 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:07.415799 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-c6df4a88-bc09-479f-b0cf-d5e47766b27f req-7d3da7b4-8102-41da-982b-c0bf29515303 tempest-TaggedBootDevicesTest-1806311997 None] Connection info returned from driver {'name': 'volumes/volume-6c632192-292e-476a-92f7-a3a26a1725e6', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6c632192-292e-476a-92f7-a3a26a1725e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '57944f4e-5a52-4339-b402-d48307b8888f'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:25:07.635492 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-c6df4a88-bc09-479f-b0cf-d5e47766b27f req-7d3da7b4-8102-41da-982b-c0bf29515303 tempest-TaggedBootDevicesTest-1806311997 None] attachment_update completed successfully.
Jul 16 21:25:08.225292 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:25:08.225292 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:25:08.230203 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ee2dbc-aaf7-43fa-85c7-7b3d0bc55468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92070518-dcce-43bf-9913-675ce13d6a6d', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:08.258094 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a7f072-ded2-4ba7-8921-55f5aa2a4246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:08.402722 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Volume volume-92070518-dcce-43bf-9913-675ce13d6a6d (92070518-dcce-43bf-9913-675ce13d6a6d): created successfully
Jul 16 21:25:08.408244 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a7f072-ded2-4ba7-8921-55f5aa2a4246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:08.420668 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Flow 'volume_create_manager' (f10b2d27-0e2d-434c-9d94-4b61e89981ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:25:08.447779 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-c6df4a88-bc09-479f-b0cf-d5e47766b27f req-58e602e2-4d9b-46f4-9a7b-77b6a0c3e62a tempest-TaggedBootDevicesTest-1806311997 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:25:08.544254 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-740f23e1-f784-4a9d-9ff9-410fa8e6153b tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Created volume successfully.
Jul 16 21:25:09.604908 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-c6df4a88-bc09-479f-b0cf-d5e47766b27f req-58e602e2-4d9b-46f4-9a7b-77b6a0c3e62a tempest-TaggedBootDevicesTest-1806311997 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.157s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:25:09.606494 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-c6df4a88-bc09-479f-b0cf-d5e47766b27f req-58e602e2-4d9b-46f4-9a7b-77b6a0c3e62a tempest-TaggedBootDevicesTest-1806311997 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-83999d90-80b2-4c0c-8aff-bec74809b4d9', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '83999d90-80b2-4c0c-8aff-bec74809b4d9', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:25:09.696597 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-c6df4a88-bc09-479f-b0cf-d5e47766b27f req-58e602e2-4d9b-46f4-9a7b-77b6a0c3e62a tempest-TaggedBootDevicesTest-1806311997 None] Connection info returned from driver {'name': 'volumes/volume-83999d90-80b2-4c0c-8aff-bec74809b4d9', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '83999d90-80b2-4c0c-8aff-bec74809b4d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '26444498-4b46-4d27-ab02-230eec120645'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:25:09.877089 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-c6df4a88-bc09-479f-b0cf-d5e47766b27f req-58e602e2-4d9b-46f4-9a7b-77b6a0c3e62a tempest-TaggedBootDevicesTest-1806311997 None] attachment_update completed successfully.
Jul 16 21:25:09.897276 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e485a357-9a42-40cf-a45d-b3ad1738d07b tempest-GroupSnapshotsV319Test-169844918 None] Group tempest-GroupSnapshotsV319Test-Group-895145314: creating
Jul 16 21:25:10.010033 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e485a357-9a42-40cf-a45d-b3ad1738d07b tempest-GroupSnapshotsV319Test-169844918 None] Group tempest-GroupSnapshotsV319Test-Group-895145314: created successfully
Jul 16 21:25:10.024887 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e485a357-9a42-40cf-a45d-b3ad1738d07b tempest-GroupSnapshotsV319Test-169844918 None] Create group completed successfully.
Jul 16 21:25:10.654740 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-08df1a22-8031-4d2b-953b-e8c22207e4d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:10.851150 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-c6df4a88-bc09-479f-b0cf-d5e47766b27f req-ee1255fb-e137-44d7-ab48-ee4412bf4861 tempest-TaggedBootDevicesTest-1806311997 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:25:11.848898 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-c6df4a88-bc09-479f-b0cf-d5e47766b27f req-ee1255fb-e137-44d7-ab48-ee4412bf4861 tempest-TaggedBootDevicesTest-1806311997 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.998s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:25:11.852577 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-c6df4a88-bc09-479f-b0cf-d5e47766b27f req-ee1255fb-e137-44d7-ab48-ee4412bf4861 tempest-TaggedBootDevicesTest-1806311997 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f0883a5a-4e31-4e72-9db6-7d56ee50023e', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'f0883a5a-4e31-4e72-9db6-7d56ee50023e', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:25:11.856353 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=65,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:25:11.985960 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-c6df4a88-bc09-479f-b0cf-d5e47766b27f req-ee1255fb-e137-44d7-ab48-ee4412bf4861 tempest-TaggedBootDevicesTest-1806311997 None] Connection info returned from driver {'name': 'volumes/volume-f0883a5a-4e31-4e72-9db6-7d56ee50023e', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f0883a5a-4e31-4e72-9db6-7d56ee50023e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fdd69779-04fa-4ff5-b249-c0c3cfa904e2'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:25:12.143430 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=69,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:25:12.159187 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-c6df4a88-bc09-479f-b0cf-d5e47766b27f req-ee1255fb-e137-44d7-ab48-ee4412bf4861 tempest-TaggedBootDevicesTest-1806311997 None] attachment_update completed successfully.
Jul 16 21:25:12.211677 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:25:12.244626 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Flow 'volume_create_manager' (87a904aa-9936-4b4d-9ca2-c716795c22e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:25:12.261828 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261704c3-d06e-4a3a-9451-a2ed9978516d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:12.280671 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261704c3-d06e-4a3a-9451-a2ed9978516d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-865502857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=20b78a4d-dd06-4d80-9469-7d3d414c426b,host='ncdv-master-1@ceph#ceph',id=074338f5-5286-498f-935f-3c753c6dc7cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9761cbc2eb3942e18fc79afbf73cd46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:25:12Z,use_quota=True,user_id='602cb3d0d5bd419697f51c81343604de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de0b774f-7b76-4f0a-be2e-3f75c5e2d239),volume_type_id=de0b774f-7b76-4f0a-be2e-3f75c5e2d239)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:12.286264 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742f7d66-6248-4dfc-8eee-8338fb753f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:12.301050 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742f7d66-6248-4dfc-8eee-8338fb753f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:12.301050 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f15f99-ecb4-48b9-bf20-aa8765ee7c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:12.301050 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f15f99-ecb4-48b9-bf20-aa8765ee7c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '074338f5-5286-498f-935f-3c753c6dc7cf', 'volume_name': 'volume-074338f5-5286-498f-935f-3c753c6dc7cf', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:12.304516 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e30f5a-d158-41c9-9506-e174e4c4833c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:12.309337 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e30f5a-d158-41c9-9506-e174e4c4833c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:12.314106 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1c2d22-da70-4efa-b5a2-f828e0b93fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:12.315244 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Volume 074338f5-5286-498f-935f-3c753c6dc7cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-074338f5-5286-498f-935f-3c753c6dc7cf', 'volume_size': 1}
Jul 16 21:25:12.315696 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] creating volume 'volume-074338f5-5286-498f-935f-3c753c6dc7cf' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:25:12.316648 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:13.347171 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-08df1a22-8031-4d2b-953b-e8c22207e4d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Create snapshot completed successfully
Jul 16 21:25:13.354472 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] extra_specs: {} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:25:13.354930 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] extra_specs: {} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:25:13.358898 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1c2d22-da70-4efa-b5a2-f828e0b93fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-074338f5-5286-498f-935f-3c753c6dc7cf', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:13.363447 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d9718d-95d3-4098-8e36-5d4c6dc4b22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:13.463113 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Volume volume-074338f5-5286-498f-935f-3c753c6dc7cf (074338f5-5286-498f-935f-3c753c6dc7cf): created successfully
Jul 16 21:25:13.466923 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d9718d-95d3-4098-8e36-5d4c6dc4b22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:13.481356 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Flow 'volume_create_manager' (87a904aa-9936-4b4d-9ca2-c716795c22e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:25:13.579945 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-fa122f20-a04f-4497-9f0b-8fd07819bf97 tempest-GroupSnapshotsV319Test-169844918 None] Created volume successfully.
Jul 16 21:25:15.003709 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-3eab3867-a8c7-4dcb-a92e-6090276ade08 tempest-GroupSnapshotsV319Test-169844918 None] GroupSnapshot 04ac74d7-3fa7-49b8-999f-c268a51b5994: creating.
Jul 16 21:25:15.090863 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a2525ae2-2885-49cb-8c19-59d96da8419e tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Acquiring lock "cinder-1900e3ce-1acd-4164-820f-4ceb19603c61-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:25:15.113067 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a2525ae2-2885-49cb-8c19-59d96da8419e tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Lock "cinder-1900e3ce-1acd-4164-820f-4ceb19603c61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:25:15.119217 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a2525ae2-2885-49cb-8c19-59d96da8419e tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:15.333057 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3eab3867-a8c7-4dcb-a92e-6090276ade08 tempest-GroupSnapshotsV319Test-169844918 None] Group snapshot 04ac74d7-3fa7-49b8-999f-c268a51b5994: creating. {{(pid=131857) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4081}}
Jul 16 21:25:15.370797 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3eab3867-a8c7-4dcb-a92e-6090276ade08 tempest-GroupSnapshotsV319Test-169844918 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:18.546479 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-3eab3867-a8c7-4dcb-a92e-6090276ade08 tempest-GroupSnapshotsV319Test-169844918 None] group_snapshot 04ac74d7-3fa7-49b8-999f-c268a51b5994: created successfully
Jul 16 21:25:19.163092 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-a2525ae2-2885-49cb-8c19-59d96da8419e tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Created reservations ['b04b3ed8-7c14-4162-8afe-9718319fc53d', '47d1630c-86fd-41e1-b11a-f38051fdcd99', '11ffde99-cdd1-46d9-9556-19a6f899307c', '187258b9-1a28-4683-a9fd-ed3f80ac3c48'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:25:19.362928 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-a2525ae2-2885-49cb-8c19-59d96da8419e tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Delete snapshot completed successfully.
Jul 16 21:25:19.369423 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a2525ae2-2885-49cb-8c19-59d96da8419e tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Lock "cinder-1900e3ce-1acd-4164-820f-4ceb19603c61-delete_snapshot" released by "delete_snapshot" :: held 4.256s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:25:19.609882 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-372a3583-b9d8-4a18-ace4-313974284505 tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Acquiring lock "cinder-92070518-dcce-43bf-9913-675ce13d6a6d-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:25:19.627962 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-372a3583-b9d8-4a18-ace4-313974284505 tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Lock "cinder-92070518-dcce-43bf-9913-675ce13d6a6d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:25:19.751194 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-372a3583-b9d8-4a18-ace4-313974284505 tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:20.202232 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-372a3583-b9d8-4a18-ace4-313974284505 tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:25:20.202708 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-372a3583-b9d8-4a18-ace4-313974284505 tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Volume volume-92070518-dcce-43bf-9913-675ce13d6a6d is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:25:20.285325 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-372a3583-b9d8-4a18-ace4-313974284505 tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] deleting rbd volume volume-92070518-dcce-43bf-9913-675ce13d6a6d {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:25:20.837153 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b0d27589-c4b3-4ed6-9ff9-ec68e831a8e4 tempest-GroupSnapshotsV319Test-169844918 None] group_snapshot 04ac74d7-3fa7-49b8-999f-c268a51b5994: deleting
Jul 16 21:25:20.872798 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-b0d27589-c4b3-4ed6-9ff9-ec68e831a8e4 tempest-GroupSnapshotsV319Test-169844918 None] group_snapshot 04ac74d7-3fa7-49b8-999f-c268a51b5994: deleting {{(pid=131857) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4256}}
Jul 16 21:25:20.893724 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b0d27589-c4b3-4ed6-9ff9-ec68e831a8e4 tempest-GroupSnapshotsV319Test-169844918 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:25.221467 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:25:25.266092 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Flow 'volume_create_manager' (eca45a41-50f0-4de2-b962-6c6f7cb8f008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:25:25.278213 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c09732-3f82-4a9b-b3ed-c991be784755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:25.303173 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c09732-3f82-4a9b-b3ed-c991be784755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1456354727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7b097a34-dea9-4828-bbfe-ec7905fbb026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ca92a86e6c40d59071e58ce4085568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:25:25Z,use_quota=True,user_id='bba77f6ef42547f1aa8480e27868bd4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:25.312106 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4414323c-dac8-472e-a9e4-0904a3726557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:25.319085 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4414323c-dac8-472e-a9e4-0904a3726557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:25.328523 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab044525-3e49-4b19-97bd-76f7d5f80e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:25.333535 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab044525-3e49-4b19-97bd-76f7d5f80e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b097a34-dea9-4828-bbfe-ec7905fbb026', 'volume_name': 'volume-7b097a34-dea9-4828-bbfe-ec7905fbb026', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:25.340349 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1037e57-45f1-4697-826b-e65d72624b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:25.345019 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1037e57-45f1-4697-826b-e65d72624b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:25.349937 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0227e2ce-518d-4262-978f-8c148ab9ff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:25.352037 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Volume 7b097a34-dea9-4828-bbfe-ec7905fbb026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b097a34-dea9-4828-bbfe-ec7905fbb026', 'volume_size': 1}
Jul 16 21:25:25.352814 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] creating volume 'volume-7b097a34-dea9-4828-bbfe-ec7905fbb026' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:25:25.353782 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:26.098661 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-b0d27589-c4b3-4ed6-9ff9-ec68e831a8e4 tempest-GroupSnapshotsV319Test-169844918 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-557392933 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-557392933, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:25:26.099671 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-b0d27589-c4b3-4ed6-9ff9-ec68e831a8e4 tempest-GroupSnapshotsV319Test-169844918 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-557392933 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-557392933, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:25:26.213103 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-b0d27589-c4b3-4ed6-9ff9-ec68e831a8e4 tempest-GroupSnapshotsV319Test-169844918 None] Created reservations ['b4dcffe2-0603-408b-b912-78679abc7844', 'fb8db447-1a26-48c0-a8f4-b6e38f775ee9', '85ba0f77-c0c8-4c4a-94a1-8815aea559fe', '45ab6ce2-1fb3-41d2-b847-160f73c242c2'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:25:26.267743 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-372a3583-b9d8-4a18-ace4-313974284505 tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Created reservations ['855cb358-7f4a-42d2-a1cc-bb396e26114b', '9288644a-f4e4-4117-9c79-2f4f57656265', '3ae19f75-832b-4158-8675-2df2e0431452', '4a35ca1a-4567-4b94-835b-e8044b6dc82a'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:25:26.437962 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:25:26.438680 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:25:26.443414 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0227e2ce-518d-4262-978f-8c148ab9ff94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b097a34-dea9-4828-bbfe-ec7905fbb026', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:26.449559 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f65b3f7-2ee7-4b6f-a5ab-224e2f88e1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:26.561103 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Volume volume-7b097a34-dea9-4828-bbfe-ec7905fbb026 (7b097a34-dea9-4828-bbfe-ec7905fbb026): created successfully
Jul 16 21:25:26.566328 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f65b3f7-2ee7-4b6f-a5ab-224e2f88e1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:26.576886 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Flow 'volume_create_manager' (eca45a41-50f0-4de2-b962-6c6f7cb8f008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:25:26.597616 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b0d27589-c4b3-4ed6-9ff9-ec68e831a8e4 tempest-GroupSnapshotsV319Test-169844918 None] group_snapshot 04ac74d7-3fa7-49b8-999f-c268a51b5994: deleted successfully
Jul 16 21:25:26.616843 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-372a3583-b9d8-4a18-ace4-313974284505 tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:26.692323 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-372a3583-b9d8-4a18-ace4-313974284505 tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:26.781815 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-372a3583-b9d8-4a18-ace4-313974284505 tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:25:26.784832 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-37d97a6e-5b9b-4a32-b193-a6d39c06b43e tempest-AttachVolumeTestJSON-1168541016 None] Created volume successfully.
Jul 16 21:25:26.791617 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=28,cinder:SELECT=65,cinder:DELETE=2,cinder:INSERT=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:25:26.809895 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-372a3583-b9d8-4a18-ace4-313974284505 tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Deleted volume successfully.
Jul 16 21:25:26.929682 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-372a3583-b9d8-4a18-ace4-313974284505 tempest-VolumeSnapshotQuotasNegativeTestJSON-911371100 None] Lock "cinder-92070518-dcce-43bf-9913-675ce13d6a6d-delete_volume" released by "delete_volume" :: held 7.301s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:25:27.191256 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4a94177-f2d0-44aa-a2d5-acdb436c78ff tempest-GroupSnapshotsV319Test-169844918 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:27.356632 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4a94177-f2d0-44aa-a2d5-acdb436c78ff tempest-GroupSnapshotsV319Test-169844918 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:25:27.357759 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4a94177-f2d0-44aa-a2d5-acdb436c78ff tempest-GroupSnapshotsV319Test-169844918 None] Volume volume-074338f5-5286-498f-935f-3c753c6dc7cf is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:25:27.495051 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4a94177-f2d0-44aa-a2d5-acdb436c78ff tempest-GroupSnapshotsV319Test-169844918 None] deleting rbd volume volume-074338f5-5286-498f-935f-3c753c6dc7cf {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:25:29.655208 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-ca5390e6-7270-47e8-adb9-90b0199008ed req-37b6aed0-8918-4f3a-acde-585e0640b7b4 tempest-AttachVolumeTestJSON-1168541016 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:25:30.894988 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-ca5390e6-7270-47e8-adb9-90b0199008ed req-37b6aed0-8918-4f3a-acde-585e0640b7b4 tempest-AttachVolumeTestJSON-1168541016 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.240s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:25:30.896006 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-ca5390e6-7270-47e8-adb9-90b0199008ed req-37b6aed0-8918-4f3a-acde-585e0640b7b4 tempest-AttachVolumeTestJSON-1168541016 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7b097a34-dea9-4828-bbfe-ec7905fbb026', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '7b097a34-dea9-4828-bbfe-ec7905fbb026', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:25:31.025708 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-ca5390e6-7270-47e8-adb9-90b0199008ed req-37b6aed0-8918-4f3a-acde-585e0640b7b4 tempest-AttachVolumeTestJSON-1168541016 None] Connection info returned from driver {'name': 'volumes/volume-7b097a34-dea9-4828-bbfe-ec7905fbb026', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7b097a34-dea9-4828-bbfe-ec7905fbb026', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '62ac5f54-e83f-463c-81b1-08165efc497a'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:25:31.175947 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=67,cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:25:31.177595 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-ca5390e6-7270-47e8-adb9-90b0199008ed req-37b6aed0-8918-4f3a-acde-585e0640b7b4 tempest-AttachVolumeTestJSON-1168541016 None] attachment_update completed successfully.
Jul 16 21:25:31.669788 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:25:31.702856 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Flow 'volume_create_manager' (943a1d38-0bec-4045-9771-d52c5656b8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:25:31.711790 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1b0a65-b171-4253-908a-34cb88ab374f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:31.738710 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1b0a65-b171-4253-908a-34cb88ab374f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-810382442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=685a896a-62d9-4253-ae50-c46b14a0daf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da56fc78f06142aba80ca4c6e3d60475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:25:31Z,use_quota=True,user_id='bcc9aa2a091c490599f9a9c41163e2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:31.746560 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a240d7aa-49b2-416a-b1f9-36ab9d563e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:31.751557 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a240d7aa-49b2-416a-b1f9-36ab9d563e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:31.756575 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231fb85a-e081-45d1-a9e6-e9be9b244135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:31.762007 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231fb85a-e081-45d1-a9e6-e9be9b244135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '685a896a-62d9-4253-ae50-c46b14a0daf6', 'volume_name': 'volume-685a896a-62d9-4253-ae50-c46b14a0daf6', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:31.770337 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09379b12-2069-469d-a19c-cc723f29412f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:31.776240 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09379b12-2069-469d-a19c-cc723f29412f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:31.781299 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81b886f-766c-44be-bc93-174dd1dc12df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:31.782674 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Volume 685a896a-62d9-4253-ae50-c46b14a0daf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-685a896a-62d9-4253-ae50-c46b14a0daf6', 'volume_size': 1}
Jul 16 21:25:31.783276 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] creating volume 'volume-685a896a-62d9-4253-ae50-c46b14a0daf6' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:25:31.784444 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:32.065823 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-b4a94177-f2d0-44aa-a2d5-acdb436c78ff tempest-GroupSnapshotsV319Test-169844918 None] Created reservations ['1ad3b18e-9831-4f48-8757-763ad03bcea9'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:25:32.087224 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-b4a94177-f2d0-44aa-a2d5-acdb436c78ff tempest-GroupSnapshotsV319Test-169844918 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-557392933 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-557392933, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:25:32.179259 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-b4a94177-f2d0-44aa-a2d5-acdb436c78ff tempest-GroupSnapshotsV319Test-169844918 None] Created reservations ['56665860-b4b4-4357-b4dc-76489797a783', 'a474def0-0aa0-4c79-8b29-e896a4520a96', '62edca90-8be5-4b64-9bc0-653022d8c6a7', 'aac4b982-4297-4a33-a763-5350cc97eb74'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:25:32.515812 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:25:32.516195 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:25:32.519796 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81b886f-766c-44be-bc93-174dd1dc12df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-685a896a-62d9-4253-ae50-c46b14a0daf6', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:32.528992 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95f45d7-981f-41c3-8ac1-cb404df6a615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:32.608483 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Volume volume-685a896a-62d9-4253-ae50-c46b14a0daf6 (685a896a-62d9-4253-ae50-c46b14a0daf6): created successfully
Jul 16 21:25:32.612429 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95f45d7-981f-41c3-8ac1-cb404df6a615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:32.618228 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Flow 'volume_create_manager' (943a1d38-0bec-4045-9771-d52c5656b8e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:25:32.645890 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4a94177-f2d0-44aa-a2d5-acdb436c78ff tempest-GroupSnapshotsV319Test-169844918 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:32.816721 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4a94177-f2d0-44aa-a2d5-acdb436c78ff tempest-GroupSnapshotsV319Test-169844918 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:32.860708 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-b4a94177-f2d0-44aa-a2d5-acdb436c78ff tempest-GroupSnapshotsV319Test-169844918 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:25:32.866127 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b4a94177-f2d0-44aa-a2d5-acdb436c78ff tempest-GroupSnapshotsV319Test-169844918 None] Delete group completed successfully.
Jul 16 21:25:32.868688 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e1456e31-b4cd-4407-a77d-f600e0def002 tempest-ServerRescueNegativeTestJSON-439221844 None] Created volume successfully.
Jul 16 21:25:35.392917 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:25:35.395619 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:35.498420 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:35.549604 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:25:36.186221 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:25:36.247543 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Flow 'volume_create_manager' (7faead5c-9f42-4e3e-898e-b48cbd118bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:25:36.256131 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80fbfe20-e0c2-4aec-8ae6-8e125dcf3ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:36.286457 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80fbfe20-e0c2-4aec-8ae6-8e125dcf3ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1724059777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3ccd2b28-b8d9-4808-87c3-7306b06d5014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='157b9e8c2932496db38da85b71c4024c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:25:36Z,use_quota=True,user_id='c7e2a9b5d9964c7bb25c7bdbbb71acaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49b2c123-0d0c-4298-b553-3a157d56fd07),volume_type_id=49b2c123-0d0c-4298-b553-3a157d56fd07)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:36.300486 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4860e933-7585-4a7c-b7a5-abbb679f5772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:36.306201 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4860e933-7585-4a7c-b7a5-abbb679f5772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:36.311520 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c60382-e0d6-4824-88c5-e831ef874b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:36.316460 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c60382-e0d6-4824-88c5-e831ef874b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ccd2b28-b8d9-4808-87c3-7306b06d5014', 'volume_name': 'volume-3ccd2b28-b8d9-4808-87c3-7306b06d5014', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:36.322341 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c42a49-3866-4835-b86d-1c16c6aee0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:36.326273 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c42a49-3866-4835-b86d-1c16c6aee0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:36.331276 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee4dcfd-45cd-45fc-b96d-5957ab662de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:36.332598 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Volume 3ccd2b28-b8d9-4808-87c3-7306b06d5014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ccd2b28-b8d9-4808-87c3-7306b06d5014', 'volume_size': 1}
Jul 16 21:25:36.333056 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] creating volume 'volume-3ccd2b28-b8d9-4808-87c3-7306b06d5014' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:25:36.333974 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:36.525157 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:25:36.549145 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Flow 'volume_create_manager' (0f850ea3-bad8-4666-9762-358edea78739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:25:36.552497 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733bd93a-edd3-434c-950b-ffbc59b30ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:36.569775 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733bd93a-edd3-434c-950b-ffbc59b30ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2091502554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9262d444-5441-481e-aaac-410ded7b62bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ca92a86e6c40d59071e58ce4085568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:25:36Z,use_quota=True,user_id='bba77f6ef42547f1aa8480e27868bd4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:36.575780 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf1dfdf-a9df-4f10-abd9-50257a21ba54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:36.579921 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf1dfdf-a9df-4f10-abd9-50257a21ba54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:36.585334 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d9721c-1ca4-4e9e-8c5c-0696611aff6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:36.589905 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d9721c-1ca4-4e9e-8c5c-0696611aff6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9262d444-5441-481e-aaac-410ded7b62bd', 'volume_name': 'volume-9262d444-5441-481e-aaac-410ded7b62bd', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:36.594569 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0555d6ec-bd21-4286-a2a0-4304b70b28fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:36.598635 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0555d6ec-bd21-4286-a2a0-4304b70b28fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:36.604364 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff55873-0f7a-4579-a750-964de8589283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:36.605416 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Volume 9262d444-5441-481e-aaac-410ded7b62bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9262d444-5441-481e-aaac-410ded7b62bd', 'volume_size': 1}
Jul 16 21:25:36.605805 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] creating volume 'volume-9262d444-5441-481e-aaac-410ded7b62bd' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:25:36.606442 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:37.141799 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:25:37.141799 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:25:37.145463 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee4dcfd-45cd-45fc-b96d-5957ab662de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ccd2b28-b8d9-4808-87c3-7306b06d5014', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:37.150992 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843aac48-6bf8-471d-b8b0-0d5afde45885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:37.254969 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Volume volume-3ccd2b28-b8d9-4808-87c3-7306b06d5014 (3ccd2b28-b8d9-4808-87c3-7306b06d5014): created successfully
Jul 16 21:25:37.260454 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843aac48-6bf8-471d-b8b0-0d5afde45885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:37.269867 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Flow 'volume_create_manager' (7faead5c-9f42-4e3e-898e-b48cbd118bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:25:37.339570 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-c5dbe490-0475-494a-8a93-d1d200dd5793 tempest-VolumeTypesTest-670302930 None] Created volume successfully.
Jul 16 21:25:37.347103 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:25:37.347855 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:25:37.355462 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff55873-0f7a-4579-a750-964de8589283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9262d444-5441-481e-aaac-410ded7b62bd', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:37.360536 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e77b18-8055-4b47-9b69-2b115e0a998d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:37.470629 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Volume volume-9262d444-5441-481e-aaac-410ded7b62bd (9262d444-5441-481e-aaac-410ded7b62bd): created successfully
Jul 16 21:25:37.474323 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e77b18-8055-4b47-9b69-2b115e0a998d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:37.480641 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Flow 'volume_create_manager' (0f850ea3-bad8-4666-9762-358edea78739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:25:37.551207 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-0022e0d5-640b-438e-be6c-d4b79ab0749c tempest-AttachVolumeTestJSON-1168541016 None] Created volume successfully.
Jul 16 21:25:38.520974 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=64,cinder:UPDATE=29,cinder:INSERT=5,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:25:38.910521 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-89115210-46a5-43ee-a4eb-ad3999f60eca tempest-VolumeTypesTest-670302930 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:38.992118 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-89115210-46a5-43ee-a4eb-ad3999f60eca tempest-VolumeTypesTest-670302930 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:39.087363 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-89115210-46a5-43ee-a4eb-ad3999f60eca tempest-VolumeTypesTest-670302930 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:25:39.093283 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-89115210-46a5-43ee-a4eb-ad3999f60eca tempest-VolumeTypesTest-670302930 None] Retype volume completed successfully.
Jul 16 21:25:39.768735 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-402e51e8-40f2-41ce-9962-edcf23ffefed req-3c0925b6-cd54-4773-800b-2bf5828f55a6 tempest-AttachVolumeTestJSON-1168541016 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:25:40.841908 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-402e51e8-40f2-41ce-9962-edcf23ffefed req-3c0925b6-cd54-4773-800b-2bf5828f55a6 tempest-AttachVolumeTestJSON-1168541016 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.074s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:25:40.842970 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-402e51e8-40f2-41ce-9962-edcf23ffefed req-3c0925b6-cd54-4773-800b-2bf5828f55a6 tempest-AttachVolumeTestJSON-1168541016 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9262d444-5441-481e-aaac-410ded7b62bd', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '9262d444-5441-481e-aaac-410ded7b62bd', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:25:40.980463 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-402e51e8-40f2-41ce-9962-edcf23ffefed req-3c0925b6-cd54-4773-800b-2bf5828f55a6 tempest-AttachVolumeTestJSON-1168541016 None] Connection info returned from driver {'name': 'volumes/volume-9262d444-5441-481e-aaac-410ded7b62bd', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9262d444-5441-481e-aaac-410ded7b62bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ac7fd743-2d02-4c00-b7e0-e1c4ae08b1f4'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:25:41.078793 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b3c602d8-08df-421f-b572-925239baea2b tempest-GroupsV320Test-1868926121 None] Group tempest-GroupsV320Test-Group-218085809: creating
Jul 16 21:25:41.200748 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b3c602d8-08df-421f-b572-925239baea2b tempest-GroupsV320Test-1868926121 None] Group tempest-GroupsV320Test-Group-218085809: created successfully
Jul 16 21:25:41.224073 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b3c602d8-08df-421f-b572-925239baea2b tempest-GroupsV320Test-1868926121 None] Create group completed successfully.
Jul 16 21:25:41.248691 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-402e51e8-40f2-41ce-9962-edcf23ffefed req-3c0925b6-cd54-4773-800b-2bf5828f55a6 tempest-AttachVolumeTestJSON-1168541016 None] attachment_update completed successfully.
Jul 16 21:25:42.688406 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-f01edb3d-92c6-42e0-94f6-8976b5ef4f83 tempest-GroupsV320Test-1868926121 None] Created reservations ['7c5747f1-33af-4d4c-b930-5f30b9947ffe'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:25:42.908118 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f01edb3d-92c6-42e0-94f6-8976b5ef4f83 tempest-GroupsV320Test-1868926121 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:43.019428 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f01edb3d-92c6-42e0-94f6-8976b5ef4f83 tempest-GroupsV320Test-1868926121 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:43.089270 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-f01edb3d-92c6-42e0-94f6-8976b5ef4f83 tempest-GroupsV320Test-1868926121 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:25:43.093437 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f01edb3d-92c6-42e0-94f6-8976b5ef4f83 tempest-GroupsV320Test-1868926121 None] Delete group completed successfully.
Jul 16 21:25:43.739048 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-2a79d769-eb1c-4858-8d57-9e68b91730c7 tempest-VolumeTypesTest-670302930 None] Acquiring lock "cinder-3ccd2b28-b8d9-4808-87c3-7306b06d5014-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:25:43.767714 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-2a79d769-eb1c-4858-8d57-9e68b91730c7 tempest-VolumeTypesTest-670302930 None] Lock "cinder-3ccd2b28-b8d9-4808-87c3-7306b06d5014-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:25:43.946461 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2a79d769-eb1c-4858-8d57-9e68b91730c7 tempest-VolumeTypesTest-670302930 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:44.184987 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2a79d769-eb1c-4858-8d57-9e68b91730c7 tempest-VolumeTypesTest-670302930 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:25:44.186787 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2a79d769-eb1c-4858-8d57-9e68b91730c7 tempest-VolumeTypesTest-670302930 None] Volume volume-3ccd2b28-b8d9-4808-87c3-7306b06d5014 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:25:44.299853 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2a79d769-eb1c-4858-8d57-9e68b91730c7 tempest-VolumeTypesTest-670302930 None] deleting rbd volume volume-3ccd2b28-b8d9-4808-87c3-7306b06d5014 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:25:48.338791 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-2a79d769-eb1c-4858-8d57-9e68b91730c7 tempest-VolumeTypesTest-670302930 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1084098108 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1084098108, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:25:48.340515 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-2a79d769-eb1c-4858-8d57-9e68b91730c7 tempest-VolumeTypesTest-670302930 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1084098108 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1084098108, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:25:48.356583 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=75,cinder:UPDATE=22,cinder:DELETE=1,cinder:INSERT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:25:48.459923 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-2a79d769-eb1c-4858-8d57-9e68b91730c7 tempest-VolumeTypesTest-670302930 None] Created reservations ['258f6ade-d9e6-4c68-826a-cbe6b3f6ccb2', '396c0a93-2682-4867-a8de-4f45bad7aaba', '59191269-df8e-4320-8991-5588f74b5c69', '0bdaf2e0-91bc-4a50-aa61-b7db0d7cb7d5'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:25:48.627529 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-5d724e08-6e2b-4101-91b2-3d3dea7ebcd0 req-e72aa369-f7fa-4ad4-8f77-b998ed93683a tempest-AttachVolumeTestJSON-1168541016 None] Terminate volume connection completed successfully.
Jul 16 21:25:48.629325 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-5d724e08-6e2b-4101-91b2-3d3dea7ebcd0 req-e72aa369-f7fa-4ad4-8f77-b998ed93683a tempest-AttachVolumeTestJSON-1168541016 None] Deleting attachment 62ac5f54-e83f-463c-81b1-08165efc497a. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:25:48.739505 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2a79d769-eb1c-4858-8d57-9e68b91730c7 tempest-VolumeTypesTest-670302930 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:48.801351 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2a79d769-eb1c-4858-8d57-9e68b91730c7 tempest-VolumeTypesTest-670302930 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:48.915489 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-2a79d769-eb1c-4858-8d57-9e68b91730c7 tempest-VolumeTypesTest-670302930 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:25:48.919740 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-2a79d769-eb1c-4858-8d57-9e68b91730c7 tempest-VolumeTypesTest-670302930 None] Deleted volume successfully.
Jul 16 21:25:49.013662 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-2a79d769-eb1c-4858-8d57-9e68b91730c7 tempest-VolumeTypesTest-670302930 None] Lock "cinder-3ccd2b28-b8d9-4808-87c3-7306b06d5014-delete_volume" released by "delete_volume" :: held 5.247s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:25:52.478768 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-2c5c60fb-c4f2-4513-842b-39d59aa5dd06 req-293670df-466d-4264-9608-96ae78e6d8a7 tempest-AttachVolumeTestJSON-1168541016 None] Terminate volume connection completed successfully.
Jul 16 21:25:52.485745 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-2c5c60fb-c4f2-4513-842b-39d59aa5dd06 req-293670df-466d-4264-9608-96ae78e6d8a7 tempest-AttachVolumeTestJSON-1168541016 None] Deleting attachment ac7fd743-2d02-4c00-b7e0-e1c4ae08b1f4. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:25:53.940063 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:25:53.982624 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Flow 'volume_create_manager' (1e15e6e1-8b9b-41d4-a166-2303b5ef3e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:25:53.992664 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da0c294-9d61-4a7e-8b2d-471404911972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:54.019982 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da0c294-9d61-4a7e-8b2d-471404911972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1118499152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f605ed78-a679-456f-9459-a333b8544f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbcf15429e7f4b638f3b61e1c8f9244b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:25:54Z,use_quota=True,user_id='2e1a1216c7544596b090ce9644e35290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd646d72-5d90-4beb-8a3f-c2dc11303022),volume_type_id=cd646d72-5d90-4beb-8a3f-c2dc11303022)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:54.027865 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb215d9c-9d20-4dcd-ad8b-2281cb4d5dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:54.034565 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb215d9c-9d20-4dcd-ad8b-2281cb4d5dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:54.040658 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fcf6dcc-3451-4ce9-a1df-31a78d539e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:54.046410 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fcf6dcc-3451-4ce9-a1df-31a78d539e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f605ed78-a679-456f-9459-a333b8544f4a', 'volume_name': 'volume-f605ed78-a679-456f-9459-a333b8544f4a', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:54.053958 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38dbc082-ccdc-43a3-b20b-b1bbb9ffabe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:54.059602 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38dbc082-ccdc-43a3-b20b-b1bbb9ffabe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:54.067726 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31877674-7e11-4d57-acb6-38f4939f5551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:54.077216 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Volume f605ed78-a679-456f-9459-a333b8544f4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f605ed78-a679-456f-9459-a333b8544f4a', 'volume_size': 1}
Jul 16 21:25:54.082560 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] creating volume 'volume-f605ed78-a679-456f-9459-a333b8544f4a' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:25:54.082560 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:54.694722 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] extra_specs: {} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:25:54.694722 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] extra_specs: {} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:25:54.694722 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31877674-7e11-4d57-acb6-38f4939f5551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f605ed78-a679-456f-9459-a333b8544f4a', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:54.698252 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5026527a-9d29-49d8-b201-0623ee722be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:25:54.744022 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Volume volume-f605ed78-a679-456f-9459-a333b8544f4a (f605ed78-a679-456f-9459-a333b8544f4a): created successfully
Jul 16 21:25:54.749167 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5026527a-9d29-49d8-b201-0623ee722be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:25:54.757564 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Flow 'volume_create_manager' (1e15e6e1-8b9b-41d4-a166-2303b5ef3e5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:25:54.807216 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e7d8de85-eba9-4777-ac7c-a10428d7c6e8 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Created volume successfully.
Jul 16 21:25:57.409758 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-675f35c1-c705-40f2-9b27-4ee848cdf640 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:57.478986 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-675f35c1-c705-40f2-9b27-4ee848cdf640 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:57.539481 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-675f35c1-c705-40f2-9b27-4ee848cdf640 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:25:57.544634 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-675f35c1-c705-40f2-9b27-4ee848cdf640 tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Retype volume completed successfully.
Jul 16 21:25:58.503119 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-2576ba2a-2903-49f5-84b8-760ebe8bee8e tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Acquiring lock "cinder-f605ed78-a679-456f-9459-a333b8544f4a-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:25:58.520235 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-2576ba2a-2903-49f5-84b8-760ebe8bee8e tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Lock "cinder-f605ed78-a679-456f-9459-a333b8544f4a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:25:58.713325 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2576ba2a-2903-49f5-84b8-760ebe8bee8e tempest-VolumeRetypeWithoutMigrationTest-258928668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:25:58.955979 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2576ba2a-2903-49f5-84b8-760ebe8bee8e tempest-VolumeRetypeWithoutMigrationTest-258928668 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:25:58.957632 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2576ba2a-2903-49f5-84b8-760ebe8bee8e tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Volume volume-f605ed78-a679-456f-9459-a333b8544f4a is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:25:59.105812 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2576ba2a-2903-49f5-84b8-760ebe8bee8e tempest-VolumeRetypeWithoutMigrationTest-258928668 None] deleting rbd volume volume-f605ed78-a679-456f-9459-a333b8544f4a {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:26:02.371576 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-2576ba2a-2903-49f5-84b8-760ebe8bee8e tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:26:02.371576 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-2576ba2a-2903-49f5-84b8-760ebe8bee8e tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:26:02.386900 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=70,cinder:UPDATE=25,cinder:INSERT=4,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:26:02.486886 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-2576ba2a-2903-49f5-84b8-760ebe8bee8e tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Created reservations ['e457881f-cdc4-4b1f-a7df-c66d7d830354', 'a2b5937d-ee39-431f-bebe-700a706aa5b2', 'a414de86-d936-45aa-bf1c-75e702fbeb6e', '62ffe403-3fb9-4a8f-bf6d-1404abce863f'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:26:02.751049 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2576ba2a-2903-49f5-84b8-760ebe8bee8e tempest-VolumeRetypeWithoutMigrationTest-258928668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:02.803086 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2576ba2a-2903-49f5-84b8-760ebe8bee8e tempest-VolumeRetypeWithoutMigrationTest-258928668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:02.891550 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-2576ba2a-2903-49f5-84b8-760ebe8bee8e tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:26:02.913100 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-1bfda2c5-a545-46ba-9b81-61c89a785c2e tempest-AttachVolumeTestJSON-1168541016 None] Acquiring lock "cinder-9262d444-5441-481e-aaac-410ded7b62bd-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:26:02.937543 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-2576ba2a-2903-49f5-84b8-760ebe8bee8e tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Deleted volume successfully.
Jul 16 21:26:03.247174 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-1bfda2c5-a545-46ba-9b81-61c89a785c2e tempest-AttachVolumeTestJSON-1168541016 None] Lock "cinder-9262d444-5441-481e-aaac-410ded7b62bd-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:26:03.247174 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-2576ba2a-2903-49f5-84b8-760ebe8bee8e tempest-VolumeRetypeWithoutMigrationTest-258928668 None] Lock "cinder-f605ed78-a679-456f-9459-a333b8544f4a-delete_volume" released by "delete_volume" :: held 4.538s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:26:03.247174 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1bfda2c5-a545-46ba-9b81-61c89a785c2e tempest-AttachVolumeTestJSON-1168541016 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:03.538885 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1bfda2c5-a545-46ba-9b81-61c89a785c2e tempest-AttachVolumeTestJSON-1168541016 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:26:03.539571 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1bfda2c5-a545-46ba-9b81-61c89a785c2e tempest-AttachVolumeTestJSON-1168541016 None] Volume volume-9262d444-5441-481e-aaac-410ded7b62bd is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:26:03.693575 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1bfda2c5-a545-46ba-9b81-61c89a785c2e tempest-AttachVolumeTestJSON-1168541016 None] deleting rbd volume volume-9262d444-5441-481e-aaac-410ded7b62bd {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:26:05.606755 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:26:05.653709 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Flow 'volume_create_manager' (beeeeff4-5101-4ff1-b9fc-ce0b0a27fabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:26:05.660543 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d487f71-b45d-4bb0-94a5-f7c0787b56f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:05.680025 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d487f71-b45d-4bb0-94a5-f7c0787b56f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-957558320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ef2aabbb-6e8c-404e-82ba-6e58cf1b86c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e352d74c8674c3789b1b5ea8c25a2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:26:05Z,use_quota=True,user_id='a1c3c91a8eed4871a9c74ba0485d08ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:05.686467 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438fd249-2a3f-45d3-8a31-e082c3c4ee62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:05.696751 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438fd249-2a3f-45d3-8a31-e082c3c4ee62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:05.704794 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e824a8a3-828f-4eb9-b905-7f7fc1c69f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:05.711685 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e824a8a3-828f-4eb9-b905-7f7fc1c69f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2aabbb-6e8c-404e-82ba-6e58cf1b86c3', 'volume_name': 'volume-ef2aabbb-6e8c-404e-82ba-6e58cf1b86c3', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:05.721432 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a43cdb-297b-4247-87f8-8d04c7c81896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:05.729786 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a43cdb-297b-4247-87f8-8d04c7c81896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:05.738410 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a68d825-3346-4c7c-b5d1-54545ad586e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:05.740945 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Volume ef2aabbb-6e8c-404e-82ba-6e58cf1b86c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2aabbb-6e8c-404e-82ba-6e58cf1b86c3', 'volume_size': 1}
Jul 16 21:26:05.741353 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] creating volume 'volume-ef2aabbb-6e8c-404e-82ba-6e58cf1b86c3' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:26:05.742188 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:06.890861 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:26:06.891913 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:26:06.898728 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a68d825-3346-4c7c-b5d1-54545ad586e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2aabbb-6e8c-404e-82ba-6e58cf1b86c3', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:06.903874 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861d8ef8-bb83-4fdc-8091-1202fd9dcb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:07.041042 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Volume volume-ef2aabbb-6e8c-404e-82ba-6e58cf1b86c3 (ef2aabbb-6e8c-404e-82ba-6e58cf1b86c3): created successfully
Jul 16 21:26:07.044646 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861d8ef8-bb83-4fdc-8091-1202fd9dcb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:07.050311 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Flow 'volume_create_manager' (beeeeff4-5101-4ff1-b9fc-ce0b0a27fabc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:26:07.128247 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f7cb4482-6d67-4714-9e24-db8bddda618e tempest-AbsoluteLimitsTests-271535198 None] Created volume successfully.
Jul 16 21:26:07.627177 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-1bfda2c5-a545-46ba-9b81-61c89a785c2e tempest-AttachVolumeTestJSON-1168541016 None] Created reservations ['3d44d4de-b3ab-4c31-a82e-a07add3ba4dd', '60eb4591-e5df-40f3-bfe2-f75119cb8d93', 'f5aca4a3-b2e9-45a6-9a5b-bbb9990b9da4', '07cd551d-636c-47fc-9c3b-543797520ff6'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:26:07.672157 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5b94de95-e6b0-4371-be45-cface1c612bf tempest-AbsoluteLimitsTests-271535198 None] Acquiring lock "cinder-ef2aabbb-6e8c-404e-82ba-6e58cf1b86c3-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:26:07.683742 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5b94de95-e6b0-4371-be45-cface1c612bf tempest-AbsoluteLimitsTests-271535198 None] Lock "cinder-ef2aabbb-6e8c-404e-82ba-6e58cf1b86c3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:26:07.795670 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5b94de95-e6b0-4371-be45-cface1c612bf tempest-AbsoluteLimitsTests-271535198 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:07.937752 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5b94de95-e6b0-4371-be45-cface1c612bf tempest-AbsoluteLimitsTests-271535198 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:26:07.938367 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5b94de95-e6b0-4371-be45-cface1c612bf tempest-AbsoluteLimitsTests-271535198 None] Volume volume-ef2aabbb-6e8c-404e-82ba-6e58cf1b86c3 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:26:07.998118 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5b94de95-e6b0-4371-be45-cface1c612bf tempest-AbsoluteLimitsTests-271535198 None] deleting rbd volume volume-ef2aabbb-6e8c-404e-82ba-6e58cf1b86c3 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:26:08.004365 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1bfda2c5-a545-46ba-9b81-61c89a785c2e tempest-AttachVolumeTestJSON-1168541016 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:08.063341 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1bfda2c5-a545-46ba-9b81-61c89a785c2e tempest-AttachVolumeTestJSON-1168541016 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:08.238104 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-1bfda2c5-a545-46ba-9b81-61c89a785c2e tempest-AttachVolumeTestJSON-1168541016 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:26:08.245307 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-1bfda2c5-a545-46ba-9b81-61c89a785c2e tempest-AttachVolumeTestJSON-1168541016 None] Deleted volume successfully.
Jul 16 21:26:08.413741 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-1bfda2c5-a545-46ba-9b81-61c89a785c2e tempest-AttachVolumeTestJSON-1168541016 None] Lock "cinder-9262d444-5441-481e-aaac-410ded7b62bd-delete_volume" released by "delete_volume" :: held 5.430s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:26:08.420271 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f742cbec-ffca-4230-971b-eb65cb3e3464 tempest-AttachVolumeTestJSON-1168541016 None] Acquiring lock "cinder-7b097a34-dea9-4828-bbfe-ec7905fbb026-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:26:08.442026 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f742cbec-ffca-4230-971b-eb65cb3e3464 tempest-AttachVolumeTestJSON-1168541016 None] Lock "cinder-7b097a34-dea9-4828-bbfe-ec7905fbb026-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:26:08.647162 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f742cbec-ffca-4230-971b-eb65cb3e3464 tempest-AttachVolumeTestJSON-1168541016 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:09.109632 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f742cbec-ffca-4230-971b-eb65cb3e3464 tempest-AttachVolumeTestJSON-1168541016 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:26:09.110221 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f742cbec-ffca-4230-971b-eb65cb3e3464 tempest-AttachVolumeTestJSON-1168541016 None] Volume volume-7b097a34-dea9-4828-bbfe-ec7905fbb026 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:26:09.304259 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f742cbec-ffca-4230-971b-eb65cb3e3464 tempest-AttachVolumeTestJSON-1168541016 None] deleting rbd volume volume-7b097a34-dea9-4828-bbfe-ec7905fbb026 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:26:14.057674 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=63,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=6 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:26:14.179540 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-5b94de95-e6b0-4371-be45-cface1c612bf tempest-AbsoluteLimitsTests-271535198 None] Created reservations ['7ae93597-d88f-43cf-bb68-650b6942c238', 'b0e8049b-4049-4239-bd3d-a26c1bf7c6a6', '3214d11c-1fde-4d8a-87a0-1eef3c03e278', 'a15bab81-d1aa-4a81-8090-55d0d65af720'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:26:14.476575 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5b94de95-e6b0-4371-be45-cface1c612bf tempest-AbsoluteLimitsTests-271535198 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:14.555300 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5b94de95-e6b0-4371-be45-cface1c612bf tempest-AbsoluteLimitsTests-271535198 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:14.650504 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-5b94de95-e6b0-4371-be45-cface1c612bf tempest-AbsoluteLimitsTests-271535198 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:26:14.655918 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-5b94de95-e6b0-4371-be45-cface1c612bf tempest-AbsoluteLimitsTests-271535198 None] Deleted volume successfully.
Jul 16 21:26:14.765090 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5b94de95-e6b0-4371-be45-cface1c612bf tempest-AbsoluteLimitsTests-271535198 None] Lock "cinder-ef2aabbb-6e8c-404e-82ba-6e58cf1b86c3-delete_volume" released by "delete_volume" :: held 7.081s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:26:15.345094 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-f742cbec-ffca-4230-971b-eb65cb3e3464 tempest-AttachVolumeTestJSON-1168541016 None] Created reservations ['165297fc-90c8-461e-9d69-464f59b2643c', '5e974f99-7040-4747-b362-09380abc852c', '5551b104-a212-47e4-ae77-3b650f6cc166', '3a15c8f7-af6c-4a26-97db-9b54bcb590ad'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:26:15.503895 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=47,cinder:UPDATE=42,cinder:INSERT=9,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:26:15.589735 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f742cbec-ffca-4230-971b-eb65cb3e3464 tempest-AttachVolumeTestJSON-1168541016 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:15.623722 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f742cbec-ffca-4230-971b-eb65cb3e3464 tempest-AttachVolumeTestJSON-1168541016 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:15.666297 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-f742cbec-ffca-4230-971b-eb65cb3e3464 tempest-AttachVolumeTestJSON-1168541016 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:26:15.675897 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f742cbec-ffca-4230-971b-eb65cb3e3464 tempest-AttachVolumeTestJSON-1168541016 None] Deleted volume successfully.
Jul 16 21:26:15.754008 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f742cbec-ffca-4230-971b-eb65cb3e3464 tempest-AttachVolumeTestJSON-1168541016 None] Lock "cinder-7b097a34-dea9-4828-bbfe-ec7905fbb026-delete_volume" released by "delete_volume" :: held 7.312s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:26:16.329454 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-4ff2942f-a347-4a8c-942e-19e7a66578a3 tempest-AttachVolumeTestJSON-1168541016 None] Acquiring lock "cinder-7734c56d-3537-4b9a-b18e-78dda7314333-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:26:16.376052 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-4ff2942f-a347-4a8c-942e-19e7a66578a3 tempest-AttachVolumeTestJSON-1168541016 None] Lock "cinder-7734c56d-3537-4b9a-b18e-78dda7314333-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:26:16.472053 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4ff2942f-a347-4a8c-942e-19e7a66578a3 tempest-AttachVolumeTestJSON-1168541016 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:16.634999 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4ff2942f-a347-4a8c-942e-19e7a66578a3 tempest-AttachVolumeTestJSON-1168541016 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:26:16.635542 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4ff2942f-a347-4a8c-942e-19e7a66578a3 tempest-AttachVolumeTestJSON-1168541016 None] Volume volume-7734c56d-3537-4b9a-b18e-78dda7314333 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:26:16.698535 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4ff2942f-a347-4a8c-942e-19e7a66578a3 tempest-AttachVolumeTestJSON-1168541016 None] deleting rbd volume volume-7734c56d-3537-4b9a-b18e-78dda7314333 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:26:20.248408 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:26:20.279707 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Flow 'volume_create_manager' (b8109d8e-6ffc-495e-91b4-12267bb9928c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:26:20.287504 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f052f4-26db-4d12-9eed-d71ad9c3412a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:20.306049 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f052f4-26db-4d12-9eed-d71ad9c3412a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1013121006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=cf0e16e3-e542-4b0a-b48a-9af94a7cc071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca905b8fd9304f979ed3420ac3b415fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:26:20Z,use_quota=True,user_id='42e2cd7bf8a04c1a93ab0772d56b2c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:20.315620 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a66ff9d7-38e9-49f0-b041-e7a670bcc91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:20.320271 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a66ff9d7-38e9-49f0-b041-e7a670bcc91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:20.325806 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff511ee-9b77-4512-b402-758f30655102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:20.458942 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff511ee-9b77-4512-b402-758f30655102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf0e16e3-e542-4b0a-b48a-9af94a7cc071', 'volume_name': 'volume-cf0e16e3-e542-4b0a-b48a-9af94a7cc071', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f6115b0>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:20.464213 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67500a0-73a2-4d87-b42b-8bc308f1da11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:20.468359 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67500a0-73a2-4d87-b42b-8bc308f1da11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:20.473583 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa6961f4-9f4a-4bca-81df-8da74d1e81cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:20.474952 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Volume cf0e16e3-e542-4b0a-b48a-9af94a7cc071: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf0e16e3-e542-4b0a-b48a-9af94a7cc071', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f6115b0>}
Jul 16 21:26:20.475560 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Cloning cf0e16e3-e542-4b0a-b48a-9af94a7cc071 from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9  at location (None, None). {{(pid=131857) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Jul 16 21:26:20.476317 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Acquiring lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" by "_prepare_image_cache_entry" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:26:20.490836 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:26:20.555910 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 26, 20, 496341)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:26:20.556346 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:26:20.556980 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Found cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Jul 16 21:26:20.562436 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" released by "_prepare_image_cache_entry" :: held 0.071s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:26:20.562781 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Attempting to retrieve cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Jul 16 21:26:20.589332 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-4ff2942f-a347-4a8c-942e-19e7a66578a3 tempest-AttachVolumeTestJSON-1168541016 None] Created reservations ['a319e586-8c34-4b66-a172-dbcb4142841d', '435a4175-3ba5-4524-aaf6-48788d68f093', '0f5106b2-2b3b-4f09-97ca-b22f52f5587a', 'cbc88f74-5975-4aea-890a-b6ef4cb272c6'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:26:20.623682 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 26, 20, 566884)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:26:20.624107 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:26:20.624723 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Creating from source image-volume b59b3901-b32a-4d92-81b0-6b99e88e4517 {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Jul 16 21:26:20.644459 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:20.823304 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] creating snapshot='volume-cf0e16e3-e542-4b0a-b48a-9af94a7cc071.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:26:22.297127 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] cloning 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517@volume-cf0e16e3-e542-4b0a-b48a-9af94a7cc071.clone_snap' to 'volume-cf0e16e3-e542-4b0a-b48a-9af94a7cc071' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:26:22.484317 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4ff2942f-a347-4a8c-942e-19e7a66578a3 tempest-AttachVolumeTestJSON-1168541016 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:22.562928 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4ff2942f-a347-4a8c-942e-19e7a66578a3 tempest-AttachVolumeTestJSON-1168541016 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:22.633406 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-4ff2942f-a347-4a8c-942e-19e7a66578a3 tempest-AttachVolumeTestJSON-1168541016 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:26:22.652231 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-4ff2942f-a347-4a8c-942e-19e7a66578a3 tempest-AttachVolumeTestJSON-1168541016 None] Deleted volume successfully.
Jul 16 21:26:22.666293 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:26:22.750663 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Flow 'volume_create_manager' (785461e8-8db3-48a7-b0fa-c2fa21c0dc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:26:22.780070 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7a3008-b63f-440b-82be-27b0ee32ea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:22.873334 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7a3008-b63f-440b-82be-27b0ee32ea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-453601904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a798ee507429bb70566356229535d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:26:21Z,use_quota=True,user_id='bb1f6532421745a4b0de70356748a647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:22.887641 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd451f2d-27c6-44ab-9378-6b842c16344b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:22.898849 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd451f2d-27c6-44ab-9378-6b842c16344b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:22.905311 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca268b9-b18c-461f-aead-8b3f468b1116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:22.916063 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca268b9-b18c-461f-aead-8b3f468b1116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6', 'volume_name': 'volume-be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:22.926304 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa102974-35b8-4768-81a4-53f19868acb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:22.963906 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa102974-35b8-4768-81a4-53f19868acb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:22.999518 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f27887dd-f903-4644-8041-c0d7e1dc75f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:23.006188 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Volume be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6', 'volume_size': 1}
Jul 16 21:26:23.010486 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] creating volume 'volume-be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:26:23.014182 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:23.141892 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-4ff2942f-a347-4a8c-942e-19e7a66578a3 tempest-AttachVolumeTestJSON-1168541016 None] Lock "cinder-7734c56d-3537-4b9a-b18e-78dda7314333-delete_volume" released by "delete_volume" :: held 6.767s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:26:23.428320 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945.deleted is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:26:23.428320 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:26:23.428320 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:26:24.264827 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:26:24.265135 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Marking volume cf0e16e3-e542-4b0a-b48a-9af94a7cc071 as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:26:24.280906 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:26:24.281286 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:26:24.286136 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f27887dd-f903-4644-8041-c0d7e1dc75f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:24.299475 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d39dda-a76d-44a0-8c86-aa755cf93a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:24.400345 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Volume volume-be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6 (be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6): created successfully
Jul 16 21:26:24.404286 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d39dda-a76d-44a0-8c86-aa755cf93a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:24.413159 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Flow 'volume_create_manager' (785461e8-8db3-48a7-b0fa-c2fa21c0dc0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:26:24.420510 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Copying metadata from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 to cf0e16e3-e542-4b0a-b48a-9af94a7cc071. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Jul 16 21:26:24.432033 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Creating volume glance metadata for volume cf0e16e3-e542-4b0a-b48a-9af94a7cc071 backed by image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131857) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Jul 16 21:26:24.557252 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-c23b9ced-0e67-4d6c-bea2-2ef2d352c0e8 tempest-VolumesBackupsTest-1570956956 None] Created volume successfully.
Jul 16 21:26:24.656208 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa6961f4-9f4a-4bca-81df-8da74d1e81cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf0e16e3-e542-4b0a-b48a-9af94a7cc071', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f6115b0>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:24.663420 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a2e294-a79b-426a-8536-43bd73d916c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:24.756228 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Volume volume-cf0e16e3-e542-4b0a-b48a-9af94a7cc071 (cf0e16e3-e542-4b0a-b48a-9af94a7cc071): created successfully
Jul 16 21:26:24.760375 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a2e294-a79b-426a-8536-43bd73d916c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:24.772758 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Flow 'volume_create_manager' (b8109d8e-6ffc-495e-91b4-12267bb9928c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:26:24.858892 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-a6f59d7e-044b-43cd-b3f2-2be1bb69a4b9 tempest-VolumesCloneTest-996860269 None] Created volume successfully.
Jul 16 21:26:26.488040 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:26:26.523618 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Flow 'volume_create_manager' (0afac3c1-e228-4124-a105-55edbc81e962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:26:26.529515 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597ce461-da6c-44a9-8a06-a4bbece763eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:26.547329 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597ce461-da6c-44a9-8a06-a4bbece763eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1622982172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2b727a1c-22d5-4fe2-969e-9b5936bc990b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca905b8fd9304f979ed3420ac3b415fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=cf0e16e3-e542-4b0a-b48a-9af94a7cc071,status='creating',terminated_at=None,updated_at=2022-07-16T21:26:26Z,use_quota=True,user_id='42e2cd7bf8a04c1a93ab0772d56b2c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:26.553447 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe47615-b0fd-4ead-94b1-2fac12580338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:26.556797 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe47615-b0fd-4ead-94b1-2fac12580338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:26.561765 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cca0620-e000-4a74-b7a5-f9cb523a8b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:26.580117 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cca0620-e000-4a74-b7a5-f9cb523a8b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2b727a1c-22d5-4fe2-969e-9b5936bc990b', 'volume_name': 'volume-2b727a1c-22d5-4fe2-969e-9b5936bc990b', 'volume_size': 1, 'source_volid': 'cf0e16e3-e542-4b0a-b48a-9af94a7cc071', 'source_volstatus': 'available'}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:26.586446 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae9a31b-6fa6-4ea1-8e22-5a0a15dcc30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:26.590523 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae9a31b-6fa6-4ea1-8e22-5a0a15dcc30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:26.595344 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376ae314-834e-4567-9964-cf0fd75fc0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:26.596449 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Volume 2b727a1c-22d5-4fe2-969e-9b5936bc990b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2b727a1c-22d5-4fe2-969e-9b5936bc990b', 'volume_size': 1, 'source_volid': 'cf0e16e3-e542-4b0a-b48a-9af94a7cc071', 'source_volstatus': 'available'}
Jul 16 21:26:26.619240 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:27.078019 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] creating snapshot='volume-2b727a1c-22d5-4fe2-969e-9b5936bc990b.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:26:29.469773 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] cloning 'volume-cf0e16e3-e542-4b0a-b48a-9af94a7cc071@volume-2b727a1c-22d5-4fe2-969e-9b5936bc990b.clone_snap' to 'volume-2b727a1c-22d5-4fe2-969e-9b5936bc990b' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:26:31.935712 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945.deleted is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:26:31.940448 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:26:31.940925 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:26:32.572080 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:26:32.572713 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Marking volume 2b727a1c-22d5-4fe2-969e-9b5936bc990b as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:26:32.685661 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Copying metadata from source volume cf0e16e3-e542-4b0a-b48a-9af94a7cc071 to 2b727a1c-22d5-4fe2-969e-9b5936bc990b. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Jul 16 21:26:32.787736 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376ae314-834e-4567-9964-cf0fd75fc0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b727a1c-22d5-4fe2-969e-9b5936bc990b', 'volume_size': 1, 'source_volid': 'cf0e16e3-e542-4b0a-b48a-9af94a7cc071', 'source_volstatus': 'available'}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:32.795466 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339329e6-ca65-4b8b-bb3e-d5b4b0d9f47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:32.949498 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Volume volume-2b727a1c-22d5-4fe2-969e-9b5936bc990b (2b727a1c-22d5-4fe2-969e-9b5936bc990b): created successfully
Jul 16 21:26:32.956854 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339329e6-ca65-4b8b-bb3e-d5b4b0d9f47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:32.966661 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Flow 'volume_create_manager' (0afac3c1-e228-4124-a105-55edbc81e962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:26:33.052622 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-1e110a4d-096b-4091-8ed9-da090ebf0651 tempest-VolumesCloneTest-996860269 None] Created volume successfully.
Jul 16 21:26:34.786537 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:26:34.834508 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Flow 'volume_create_manager' (fd5f4fc3-beb6-49c4-bf24-9b27bed5d538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:26:34.842762 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27861985-ec79-4ab5-bcf0-2d4592543649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:34.879749 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27861985-ec79-4ab5-bcf0-2d4592543649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2102591881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=299309ba-85be-4eb6-b2d3-888e626aab29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca905b8fd9304f979ed3420ac3b415fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:26:35Z,use_quota=True,user_id='42e2cd7bf8a04c1a93ab0772d56b2c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:34.886474 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2a5ee4-ae43-4fd9-a973-f7ab0eeaa33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:34.891219 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2a5ee4-ae43-4fd9-a973-f7ab0eeaa33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:34.899347 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39bc9991-5bd5-42e8-b8fd-dd075829b3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:34.904807 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39bc9991-5bd5-42e8-b8fd-dd075829b3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '299309ba-85be-4eb6-b2d3-888e626aab29', 'volume_name': 'volume-299309ba-85be-4eb6-b2d3-888e626aab29', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:34.910917 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76fa6691-0420-4573-b855-528a99df63af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:34.922527 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76fa6691-0420-4573-b855-528a99df63af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:34.947174 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1364a38-de55-46aa-a970-af519fae2791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:34.947672 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Volume 299309ba-85be-4eb6-b2d3-888e626aab29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-299309ba-85be-4eb6-b2d3-888e626aab29', 'volume_size': 1}
Jul 16 21:26:34.948170 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] creating volume 'volume-299309ba-85be-4eb6-b2d3-888e626aab29' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:26:34.949230 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:35.397617 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:26:35.398371 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:35.509482 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:35.554071 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:26:36.010222 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:26:36.010761 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:26:36.014562 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1364a38-de55-46aa-a970-af519fae2791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-299309ba-85be-4eb6-b2d3-888e626aab29', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:36.021864 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b3ba3c-0fc5-4d19-9bcd-918f02ed577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:36.074445 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Volume volume-299309ba-85be-4eb6-b2d3-888e626aab29 (299309ba-85be-4eb6-b2d3-888e626aab29): created successfully
Jul 16 21:26:36.078203 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b3ba3c-0fc5-4d19-9bcd-918f02ed577d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:36.084838 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Flow 'volume_create_manager' (fd5f4fc3-beb6-49c4-bf24-9b27bed5d538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:26:36.148502 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-49c738d6-6df7-440a-8bcc-fd035be7ca61 tempest-VolumesCloneTest-996860269 None] Created volume successfully.
Jul 16 21:26:37.578591 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:26:37.607884 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Flow 'volume_create_manager' (05672eb3-7d92-45f4-b175-598ca5c10cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:26:37.614310 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0bf55b-d21d-42b0-b828-c5d2674e5849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:37.632686 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0bf55b-d21d-42b0-b828-c5d2674e5849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1632091439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8b45bac4-040d-4cf1-8771-d6f6f109c1c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca905b8fd9304f979ed3420ac3b415fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:26:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=299309ba-85be-4eb6-b2d3-888e626aab29,status='creating',terminated_at=None,updated_at=2022-07-16T21:26:37Z,use_quota=True,user_id='42e2cd7bf8a04c1a93ab0772d56b2c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:37.637932 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b19f07b9-a186-4b03-b4dc-74edf552f42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:37.642038 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b19f07b9-a186-4b03-b4dc-74edf552f42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:37.647951 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc903fba-4c37-49c4-aa63-18340ce76e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:37.666413 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc903fba-4c37-49c4-aa63-18340ce76e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8b45bac4-040d-4cf1-8771-d6f6f109c1c5', 'volume_name': 'volume-8b45bac4-040d-4cf1-8771-d6f6f109c1c5', 'volume_size': 2, 'source_volid': '299309ba-85be-4eb6-b2d3-888e626aab29', 'source_volstatus': 'available'}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:37.673197 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e05c794-f6a2-40ce-8748-f7bddf0b25b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:37.675981 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e05c794-f6a2-40ce-8748-f7bddf0b25b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:37.680682 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4829a4d5-39bb-4180-9619-00676a69a29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:37.681763 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Volume 8b45bac4-040d-4cf1-8771-d6f6f109c1c5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8b45bac4-040d-4cf1-8771-d6f6f109c1c5', 'volume_size': 2, 'source_volid': '299309ba-85be-4eb6-b2d3-888e626aab29', 'source_volstatus': 'available'}
Jul 16 21:26:37.696266 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:38.085798 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] creating snapshot='volume-8b45bac4-040d-4cf1-8771-d6f6f109c1c5.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:26:41.103909 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] cloning 'volume-299309ba-85be-4eb6-b2d3-888e626aab29@volume-8b45bac4-040d-4cf1-8771-d6f6f109c1c5.clone_snap' to 'volume-8b45bac4-040d-4cf1-8771-d6f6f109c1c5' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:26:42.040757 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-6b3c1cae-b826-4d06-a524-ef81f17d0fad req-4d59b644-3204-438a-ba54-4ae568b31eea tempest-ServerRescueNegativeTestJSON-439221844 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:26:42.983435 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-6b3c1cae-b826-4d06-a524-ef81f17d0fad req-4d59b644-3204-438a-ba54-4ae568b31eea tempest-ServerRescueNegativeTestJSON-439221844 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.942s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:26:42.984068 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-6b3c1cae-b826-4d06-a524-ef81f17d0fad req-4d59b644-3204-438a-ba54-4ae568b31eea tempest-ServerRescueNegativeTestJSON-439221844 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-685a896a-62d9-4253-ae50-c46b14a0daf6', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '685a896a-62d9-4253-ae50-c46b14a0daf6', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:26:43.078293 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-6b3c1cae-b826-4d06-a524-ef81f17d0fad req-4d59b644-3204-438a-ba54-4ae568b31eea tempest-ServerRescueNegativeTestJSON-439221844 None] Connection info returned from driver {'name': 'volumes/volume-685a896a-62d9-4253-ae50-c46b14a0daf6', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '685a896a-62d9-4253-ae50-c46b14a0daf6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b574aecb-cd8c-4368-b304-a0a4bd8ff65f'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:26:43.209612 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=20,cinder:SELECT=61,cinder:DELETE=3,cinder:INSERT=16 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:26:43.210590 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=61,cinder:UPDATE=24,cinder:INSERT=12,cinder:DELETE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:26:43.224120 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-6b3c1cae-b826-4d06-a524-ef81f17d0fad req-4d59b644-3204-438a-ba54-4ae568b31eea tempest-ServerRescueNegativeTestJSON-439221844 None] attachment_update completed successfully.
Jul 16 21:26:43.470180 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Volume volume-299309ba-85be-4eb6-b2d3-888e626aab29 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:26:43.471910 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:26:43.473840 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:26:43.964277 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] resize volume 'volume-8b45bac4-040d-4cf1-8771-d6f6f109c1c5' from 1 to 2 {{(pid=131857) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:745}}
Jul 16 21:26:43.965784 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:45.321562 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-053bb311-8161-4825-8ca4-a947337e5cfc req-e9a8729d-ee15-4b0f-8759-b5ba20a25456 tempest-VolumesBackupsTest-1570956956 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:26:46.065746 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:26:46.076592 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4829a4d5-39bb-4180-9619-00676a69a29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b45bac4-040d-4cf1-8771-d6f6f109c1c5', 'volume_size': 2, 'source_volid': '299309ba-85be-4eb6-b2d3-888e626aab29', 'source_volstatus': 'available'}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:46.081670 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3e4700-88b9-4498-8a83-17ff237eb225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:26:46.208359 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-053bb311-8161-4825-8ca4-a947337e5cfc req-e9a8729d-ee15-4b0f-8759-b5ba20a25456 tempest-VolumesBackupsTest-1570956956 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.887s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:26:46.209437 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-053bb311-8161-4825-8ca4-a947337e5cfc req-e9a8729d-ee15-4b0f-8759-b5ba20a25456 tempest-VolumesBackupsTest-1570956956 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:26:46.297072 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Volume volume-8b45bac4-040d-4cf1-8771-d6f6f109c1c5 (8b45bac4-040d-4cf1-8771-d6f6f109c1c5): created successfully
Jul 16 21:26:46.297072 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3e4700-88b9-4498-8a83-17ff237eb225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:26:46.298914 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Flow 'volume_create_manager' (05672eb3-7d92-45f4-b175-598ca5c10cd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:26:46.349310 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-053bb311-8161-4825-8ca4-a947337e5cfc req-e9a8729d-ee15-4b0f-8759-b5ba20a25456 tempest-VolumesBackupsTest-1570956956 None] Connection info returned from driver {'name': 'volumes/volume-be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e82b87c6-ed60-4aa4-8d0b-4d3dd6578816'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:26:46.374466 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-40360d7e-bbaf-4c13-a033-334ef351ae8c tempest-DeleteServersTestJSON-1541892181 None] Acquiring lock "cinder-71861a5b-1ca1-4935-9349-fbb30a4fc8bc-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:26:46.378931 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-87fb4dc2-a163-401a-9b26-d8c88a534b04 tempest-VolumesCloneTest-996860269 None] Created volume successfully.
Jul 16 21:26:46.401435 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-40360d7e-bbaf-4c13-a033-334ef351ae8c tempest-DeleteServersTestJSON-1541892181 None] Lock "cinder-71861a5b-1ca1-4935-9349-fbb30a4fc8bc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:26:46.491064 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-053bb311-8161-4825-8ca4-a947337e5cfc req-e9a8729d-ee15-4b0f-8759-b5ba20a25456 tempest-VolumesBackupsTest-1570956956 None] attachment_update completed successfully.
Jul 16 21:26:46.563866 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-40360d7e-bbaf-4c13-a033-334ef351ae8c tempest-DeleteServersTestJSON-1541892181 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:46.799517 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-40360d7e-bbaf-4c13-a033-334ef351ae8c tempest-DeleteServersTestJSON-1541892181 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:26:46.799972 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-40360d7e-bbaf-4c13-a033-334ef351ae8c tempest-DeleteServersTestJSON-1541892181 None] Volume volume-71861a5b-1ca1-4935-9349-fbb30a4fc8bc is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:26:47.017111 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-40360d7e-bbaf-4c13-a033-334ef351ae8c tempest-DeleteServersTestJSON-1541892181 None] deleting rbd volume volume-71861a5b-1ca1-4935-9349-fbb30a4fc8bc {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:26:47.310237 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e0e04235-7cdf-47be-a864-c573228672f8 tempest-VolumesCloneTest-996860269 None] Acquiring lock "cinder-8b45bac4-040d-4cf1-8771-d6f6f109c1c5-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:26:47.345759 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e0e04235-7cdf-47be-a864-c573228672f8 tempest-VolumesCloneTest-996860269 None] Lock "cinder-8b45bac4-040d-4cf1-8771-d6f6f109c1c5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:26:47.472040 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e0e04235-7cdf-47be-a864-c573228672f8 tempest-VolumesCloneTest-996860269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:47.731429 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e0e04235-7cdf-47be-a864-c573228672f8 tempest-VolumesCloneTest-996860269 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:26:48.097923 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e0e04235-7cdf-47be-a864-c573228672f8 tempest-VolumesCloneTest-996860269 None] deleting rbd volume volume-8b45bac4-040d-4cf1-8771-d6f6f109c1c5 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:26:50.146226 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-08d48018-fecc-4ca0-8d8b-fbd3b9f9c9cf tempest-VolumesBackupsTest-1570956956 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-07-16T21:26:49Z,data_timestamp=2022-07-16T21:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-2056227030',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=6dfae19d-189f-4f97-a3b1-d5e2e6a8c817,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='7d5a798ee507429bb70566356229535d',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='bb1f6532421745a4b0de70356748a647',volume_id=be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6)
Jul 16 21:26:50.152017 ncdv-master-1 cinder-volume[131857]: INFO cinder.rpc [None req-08d48018-fecc-4ca0-8d8b-fbd3b9f9c9cf tempest-VolumesBackupsTest-1570956956 None] Automatically selected cinder-backup objects version 1.39 as minimum service version.
Jul 16 21:26:50.157437 ncdv-master-1 cinder-volume[131857]: INFO cinder.rpc [None req-08d48018-fecc-4ca0-8d8b-fbd3b9f9c9cf tempest-VolumesBackupsTest-1570956956 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version.
Jul 16 21:26:50.158544 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.backup.rpcapi [None req-08d48018-fecc-4ca0-8d8b-fbd3b9f9c9cf tempest-VolumesBackupsTest-1570956956 None] continue_backup in rpcapi backup_id 6dfae19d-189f-4f97-a3b1-d5e2e6a8c817 {{(pid=131857) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Jul 16 21:26:55.283388 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-40360d7e-bbaf-4c13-a033-334ef351ae8c tempest-DeleteServersTestJSON-1541892181 None] Created reservations ['e9372981-36a5-455e-b6db-f1bd7af09afc', '760083c5-fa41-40e8-9def-57b3858d7064', '5f21247f-9d20-4f2d-bc49-6d4d23c91ebd', '225aaca3-7267-4cd3-91cb-2c8560995c63'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:26:55.543319 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-40360d7e-bbaf-4c13-a033-334ef351ae8c tempest-DeleteServersTestJSON-1541892181 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:55.701501 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-40360d7e-bbaf-4c13-a033-334ef351ae8c tempest-DeleteServersTestJSON-1541892181 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:26:55.771620 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-40360d7e-bbaf-4c13-a033-334ef351ae8c tempest-DeleteServersTestJSON-1541892181 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:26:55.782710 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-40360d7e-bbaf-4c13-a033-334ef351ae8c tempest-DeleteServersTestJSON-1541892181 None] Deleted volume successfully.
Jul 16 21:26:55.803477 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e0e04235-7cdf-47be-a864-c573228672f8 tempest-VolumesCloneTest-996860269 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:26:56.023743 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e0e04235-7cdf-47be-a864-c573228672f8 tempest-VolumesCloneTest-996860269 None] Volume volume-299309ba-85be-4eb6-b2d3-888e626aab29 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:26:56.024494 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e0e04235-7cdf-47be-a864-c573228672f8 tempest-VolumesCloneTest-996860269 None] deleting parent snapshot volume-8b45bac4-040d-4cf1-8771-d6f6f109c1c5.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:26:59.684156 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-08d48018-fecc-4ca0-8d8b-fbd3b9f9c9cf tempest-VolumesBackupsTest-1570956956 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:26:59.808802 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-40360d7e-bbaf-4c13-a033-334ef351ae8c tempest-DeleteServersTestJSON-1541892181 None] Lock "cinder-71861a5b-1ca1-4935-9349-fbb30a4fc8bc-delete_volume" released by "delete_volume" :: held 13.407s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:27:00.028646 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-e0e04235-7cdf-47be-a864-c573228672f8 tempest-VolumesCloneTest-996860269 None] Created reservations ['bc352ddc-8955-4451-a17e-9f44b66250c4', 'd113bd04-622f-44c7-9aae-ade18d62c909', 'f17a98ca-de1c-4cac-8efa-a33807a06ad7', '891af05a-2f30-43d3-b4c5-ec0337c26e16'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:27:00.368609 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e0e04235-7cdf-47be-a864-c573228672f8 tempest-VolumesCloneTest-996860269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:00.475720 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e0e04235-7cdf-47be-a864-c573228672f8 tempest-VolumesCloneTest-996860269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:00.567954 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-e0e04235-7cdf-47be-a864-c573228672f8 tempest-VolumesCloneTest-996860269 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:27:00.574840 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e0e04235-7cdf-47be-a864-c573228672f8 tempest-VolumesCloneTest-996860269 None] Deleted volume successfully.
Jul 16 21:27:00.672287 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9f81c219-35c2-4cd0-b7b5-37b6169004d4 tempest-VolumesCloneTest-996860269 None] Acquiring lock "cinder-299309ba-85be-4eb6-b2d3-888e626aab29-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:27:00.697908 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9f81c219-35c2-4cd0-b7b5-37b6169004d4 tempest-VolumesCloneTest-996860269 None] Lock "cinder-299309ba-85be-4eb6-b2d3-888e626aab29-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:27:00.748102 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e0e04235-7cdf-47be-a864-c573228672f8 tempest-VolumesCloneTest-996860269 None] Lock "cinder-8b45bac4-040d-4cf1-8771-d6f6f109c1c5-delete_volume" released by "delete_volume" :: held 13.402s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:27:00.929179 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9f81c219-35c2-4cd0-b7b5-37b6169004d4 tempest-VolumesCloneTest-996860269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:01.273651 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9f81c219-35c2-4cd0-b7b5-37b6169004d4 tempest-VolumesCloneTest-996860269 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:27:01.274106 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9f81c219-35c2-4cd0-b7b5-37b6169004d4 tempest-VolumesCloneTest-996860269 None] Volume volume-299309ba-85be-4eb6-b2d3-888e626aab29 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:27:01.652597 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9f81c219-35c2-4cd0-b7b5-37b6169004d4 tempest-VolumesCloneTest-996860269 None] deleting rbd volume volume-299309ba-85be-4eb6-b2d3-888e626aab29 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:27:01.655406 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-08d48018-fecc-4ca0-8d8b-fbd3b9f9c9cf tempest-VolumesBackupsTest-1570956956 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.973s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:27:01.655972 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-08d48018-fecc-4ca0-8d8b-fbd3b9f9c9cf tempest-VolumesBackupsTest-1570956956 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:27:01.697867 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-08d48018-fecc-4ca0-8d8b-fbd3b9f9c9cf tempest-VolumesBackupsTest-1570956956 None] Initialize volume connection completed successfully.
Jul 16 21:27:10.007698 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=73,cinder:UPDATE=21,cinder:DELETE=3,cinder:INSERT=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:27:10.119819 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-9f81c219-35c2-4cd0-b7b5-37b6169004d4 tempest-VolumesCloneTest-996860269 None] Created reservations ['164bacfe-c8a4-45e4-8366-bd6835538550', '80238e89-6b2f-4601-8a8b-558129cf5f5d', '48facd71-2c3d-4f2f-94be-c7a131da3f0e', 'c9b76594-3180-4fba-8104-332d2d5a359b'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:27:10.492046 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9f81c219-35c2-4cd0-b7b5-37b6169004d4 tempest-VolumesCloneTest-996860269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:10.611582 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9f81c219-35c2-4cd0-b7b5-37b6169004d4 tempest-VolumesCloneTest-996860269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:10.672719 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-9f81c219-35c2-4cd0-b7b5-37b6169004d4 tempest-VolumesCloneTest-996860269 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:27:10.679823 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-9f81c219-35c2-4cd0-b7b5-37b6169004d4 tempest-VolumesCloneTest-996860269 None] Deleted volume successfully.
Jul 16 21:27:10.800880 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9f81c219-35c2-4cd0-b7b5-37b6169004d4 tempest-VolumesCloneTest-996860269 None] Lock "cinder-299309ba-85be-4eb6-b2d3-888e626aab29-delete_volume" released by "delete_volume" :: held 10.110s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:27:10.834300 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b47b985d-4e28-476d-bf58-88fdff28d4e5 tempest-VolumesCloneTest-996860269 None] Acquiring lock "cinder-2b727a1c-22d5-4fe2-969e-9b5936bc990b-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:27:10.848836 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b47b985d-4e28-476d-bf58-88fdff28d4e5 tempest-VolumesCloneTest-996860269 None] Lock "cinder-2b727a1c-22d5-4fe2-969e-9b5936bc990b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:27:10.967378 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b47b985d-4e28-476d-bf58-88fdff28d4e5 tempest-VolumesCloneTest-996860269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:11.290880 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b47b985d-4e28-476d-bf58-88fdff28d4e5 tempest-VolumesCloneTest-996860269 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:27:11.499772 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b47b985d-4e28-476d-bf58-88fdff28d4e5 tempest-VolumesCloneTest-996860269 None] deleting rbd volume volume-2b727a1c-22d5-4fe2-969e-9b5936bc990b {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:27:12.419986 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=55,cinder:UPDATE=35,cinder:INSERT=9,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:27:12.442857 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-08d48018-fecc-4ca0-8d8b-fbd3b9f9c9cf tempest-VolumesBackupsTest-1570956956 None] Terminate volume connection completed successfully.
Jul 16 21:27:12.493946 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-08d48018-fecc-4ca0-8d8b-fbd3b9f9c9cf tempest-VolumesBackupsTest-1570956956 None] Remove volume export completed successfully.
Jul 16 21:27:17.468999 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b47b985d-4e28-476d-bf58-88fdff28d4e5 tempest-VolumesCloneTest-996860269 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:27:17.594905 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b47b985d-4e28-476d-bf58-88fdff28d4e5 tempest-VolumesCloneTest-996860269 None] deleting parent snapshot volume-2b727a1c-22d5-4fe2-969e-9b5936bc990b.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:27:21.341805 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-b47b985d-4e28-476d-bf58-88fdff28d4e5 tempest-VolumesCloneTest-996860269 None] Created reservations ['eb6f2e02-392d-481b-ac28-73eefd2bc148', 'ee069c4e-2f07-4a4e-b1f7-a7b99c279990', '5c19cbb9-6b9c-4fc1-96e8-42664ad1aeec', '9f91e2b1-9890-4e78-9f37-7494748b9e6b'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:27:21.622646 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b47b985d-4e28-476d-bf58-88fdff28d4e5 tempest-VolumesCloneTest-996860269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:21.669715 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b47b985d-4e28-476d-bf58-88fdff28d4e5 tempest-VolumesCloneTest-996860269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:21.809003 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-b47b985d-4e28-476d-bf58-88fdff28d4e5 tempest-VolumesCloneTest-996860269 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:27:21.833547 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-35972153-0ed7-491a-adad-6576c3d795c7 tempest-VolumesCloneTest-996860269 None] Acquiring lock "cinder-cf0e16e3-e542-4b0a-b48a-9af94a7cc071-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:27:21.839197 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b47b985d-4e28-476d-bf58-88fdff28d4e5 tempest-VolumesCloneTest-996860269 None] Deleted volume successfully.
Jul 16 21:27:21.853074 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-35972153-0ed7-491a-adad-6576c3d795c7 tempest-VolumesCloneTest-996860269 None] Lock "cinder-cf0e16e3-e542-4b0a-b48a-9af94a7cc071-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:27:21.946132 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b47b985d-4e28-476d-bf58-88fdff28d4e5 tempest-VolumesCloneTest-996860269 None] Lock "cinder-2b727a1c-22d5-4fe2-969e-9b5936bc990b-delete_volume" released by "delete_volume" :: held 11.097s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:27:21.989210 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-35972153-0ed7-491a-adad-6576c3d795c7 tempest-VolumesCloneTest-996860269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:22.170354 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-35972153-0ed7-491a-adad-6576c3d795c7 tempest-VolumesCloneTest-996860269 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:27:22.373447 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-35972153-0ed7-491a-adad-6576c3d795c7 tempest-VolumesCloneTest-996860269 None] deleting rbd volume volume-cf0e16e3-e542-4b0a-b48a-9af94a7cc071 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:27:24.686853 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-ec265e51-f6db-41b4-aaff-c1da66b36a4e req-ffebfe0d-5a3f-46de-a6a9-5fa0aba44aab tempest-VolumesBackupsTest-1570956956 None] Terminate volume connection completed successfully.
Jul 16 21:27:24.687524 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-ec265e51-f6db-41b4-aaff-c1da66b36a4e req-ffebfe0d-5a3f-46de-a6a9-5fa0aba44aab tempest-VolumesBackupsTest-1570956956 None] Deleting attachment e82b87c6-ed60-4aa4-8d0b-4d3dd6578816. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:27:27.405608 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-35972153-0ed7-491a-adad-6576c3d795c7 tempest-VolumesCloneTest-996860269 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:27:27.559333 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-35972153-0ed7-491a-adad-6576c3d795c7 tempest-VolumesCloneTest-996860269 None] deleting parent snapshot volume-cf0e16e3-e542-4b0a-b48a-9af94a7cc071.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:27:30.826720 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-35972153-0ed7-491a-adad-6576c3d795c7 tempest-VolumesCloneTest-996860269 None] Created reservations ['39fccae1-7c32-40f2-8803-f362b159cb85', '04d1800b-0229-4636-a136-c64bee05d2bf', 'b0384561-3a2e-4d87-a050-4b6ba533bdd4', '4730811a-16c4-424c-b572-f6c8fb9be162'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:27:31.076662 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-35972153-0ed7-491a-adad-6576c3d795c7 tempest-VolumesCloneTest-996860269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:31.115117 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-35972153-0ed7-491a-adad-6576c3d795c7 tempest-VolumesCloneTest-996860269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:31.144235 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-35972153-0ed7-491a-adad-6576c3d795c7 tempest-VolumesCloneTest-996860269 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:27:31.148459 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-35972153-0ed7-491a-adad-6576c3d795c7 tempest-VolumesCloneTest-996860269 None] Deleted volume successfully.
Jul 16 21:27:31.229836 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-35972153-0ed7-491a-adad-6576c3d795c7 tempest-VolumesCloneTest-996860269 None] Lock "cinder-cf0e16e3-e542-4b0a-b48a-9af94a7cc071-delete_volume" released by "delete_volume" :: held 9.374s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:27:32.097470 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8cf3caa8-8eeb-4ee1-9448-519654011de4 tempest-VolumesBackupsTest-1570956956 None] Acquiring lock "cinder-be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:27:32.116049 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8cf3caa8-8eeb-4ee1-9448-519654011de4 tempest-VolumesBackupsTest-1570956956 None] Lock "cinder-be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:27:32.282016 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8cf3caa8-8eeb-4ee1-9448-519654011de4 tempest-VolumesBackupsTest-1570956956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:34.225360 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8cf3caa8-8eeb-4ee1-9448-519654011de4 tempest-VolumesBackupsTest-1570956956 None] Volume volume-be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:27:34.902899 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8cf3caa8-8eeb-4ee1-9448-519654011de4 tempest-VolumesBackupsTest-1570956956 None] deleting rbd volume volume-be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:27:35.393850 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:27:35.427972 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Flow 'volume_create_manager' (4b36e06a-19d0-4097-91b0-08aa2b160a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:27:35.434918 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1eae6d-1920-4284-ad02-13a923587943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:27:35.439877 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:27:35.445087 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:35.476795 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:35.530929 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:27:35.551858 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1eae6d-1920-4284-ad02-13a923587943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-697146461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=662e1dcb-10c2-432a-8bc7-3eb95b75c0de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfd328e0f1446369531a23d15387cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:27:35Z,use_quota=True,user_id='6771589864f442cbbfc8abf018abbd09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:27:35.557159 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8ad42e-374a-4c47-9e0c-b9298c517775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:27:35.561153 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8ad42e-374a-4c47-9e0c-b9298c517775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:27:35.566180 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a663ad-3428-4a91-846a-da2965b1835c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:27:35.570387 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a663ad-3428-4a91-846a-da2965b1835c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662e1dcb-10c2-432a-8bc7-3eb95b75c0de', 'volume_name': 'volume-662e1dcb-10c2-432a-8bc7-3eb95b75c0de', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:27:35.575204 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b340e441-5222-412c-b61b-581084363ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:27:35.579052 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b340e441-5222-412c-b61b-581084363ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:27:35.584226 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b343ea-3305-46b7-b93a-e8cab74858a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:27:35.585292 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Volume 662e1dcb-10c2-432a-8bc7-3eb95b75c0de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662e1dcb-10c2-432a-8bc7-3eb95b75c0de', 'volume_size': 1}
Jul 16 21:27:35.585663 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] creating volume 'volume-662e1dcb-10c2-432a-8bc7-3eb95b75c0de' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:27:35.586423 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:36.231956 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:27:36.232350 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:27:36.237537 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b343ea-3305-46b7-b93a-e8cab74858a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662e1dcb-10c2-432a-8bc7-3eb95b75c0de', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:27:36.242664 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2d6a3f-0d24-4682-992c-6129f5528061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:27:36.342321 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Volume volume-662e1dcb-10c2-432a-8bc7-3eb95b75c0de (662e1dcb-10c2-432a-8bc7-3eb95b75c0de): created successfully
Jul 16 21:27:36.347334 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2d6a3f-0d24-4682-992c-6129f5528061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:27:36.352996 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Flow 'volume_create_manager' (4b36e06a-19d0-4097-91b0-08aa2b160a37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:27:36.456837 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-1b12f84c-0f05-4790-afb8-d22ac1821463 tempest-VolumesNegativeTest-1381254418 None] Created volume successfully.
Jul 16 21:27:40.827356 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-8cf3caa8-8eeb-4ee1-9448-519654011de4 tempest-VolumesBackupsTest-1570956956 None] Created reservations ['4d182eef-0560-4434-9857-ccc7cf53beab', 'af9e30ca-ab10-47c2-a6ad-39d41058e56f', '99bd7da0-90ee-449d-b4f5-ceb840cc1d29', 'daa22498-134c-4894-8b67-46150ef90165'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:27:41.099679 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8cf3caa8-8eeb-4ee1-9448-519654011de4 tempest-VolumesBackupsTest-1570956956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:41.163933 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8cf3caa8-8eeb-4ee1-9448-519654011de4 tempest-VolumesBackupsTest-1570956956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:41.247413 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-8cf3caa8-8eeb-4ee1-9448-519654011de4 tempest-VolumesBackupsTest-1570956956 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:27:41.253964 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-8cf3caa8-8eeb-4ee1-9448-519654011de4 tempest-VolumesBackupsTest-1570956956 None] Deleted volume successfully.
Jul 16 21:27:41.364274 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8cf3caa8-8eeb-4ee1-9448-519654011de4 tempest-VolumesBackupsTest-1570956956 None] Lock "cinder-be0c4ae4-0277-4cb8-92f2-b87b2a58c6b6-delete_volume" released by "delete_volume" :: held 9.248s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:27:43.337766 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:27:43.392152 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Flow 'volume_create_manager' (63969887-1348-4420-8b1d-de67a5b56bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:27:43.400562 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9489903-92c7-4e73-8e31-c1e195f852d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:27:43.420377 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9489903-92c7-4e73-8e31-c1e195f852d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-504461525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c4a6df28-c5be-4ffd-b735-00aefd2ae853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a798ee507429bb70566356229535d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:27:43Z,use_quota=True,user_id='bb1f6532421745a4b0de70356748a647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:27:43.428753 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1766909-0cd5-441f-9a1e-4c8664d565e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:27:43.434918 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1766909-0cd5-441f-9a1e-4c8664d565e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:27:43.441516 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da46af2-c450-4d58-9daf-d6194fc3f47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:27:43.604488 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da46af2-c450-4d58-9daf-d6194fc3f47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c4a6df28-c5be-4ffd-b735-00aefd2ae853', 'volume_name': 'volume-c4a6df28-c5be-4ffd-b735-00aefd2ae853', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9591a7bd60>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:27:43.617686 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd427db-dd25-4a7b-b3a6-dbf6c47e01cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:27:43.646897 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd427db-dd25-4a7b-b3a6-dbf6c47e01cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:27:43.668837 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5966ca3c-e41b-40fb-8b74-b45915804f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:27:43.677287 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Volume c4a6df28-c5be-4ffd-b735-00aefd2ae853: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c4a6df28-c5be-4ffd-b735-00aefd2ae853', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9591a7bd60>}
Jul 16 21:27:43.678206 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Cloning c4a6df28-c5be-4ffd-b735-00aefd2ae853 from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9  at location (None, None). {{(pid=131857) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Jul 16 21:27:43.679025 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Acquiring lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" by "_prepare_image_cache_entry" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:27:43.745882 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" acquired by "_prepare_image_cache_entry" :: waited 0.052s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:27:43.753272 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-ca2318e1-ed5b-46f6-b925-cb5c373f4cc6 req-d8457c07-d659-46d3-a069-30079408624d tempest-ServerRescueNegativeTestJSON-439221844 None] Terminate volume connection completed successfully.
Jul 16 21:27:43.753957 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-ca2318e1-ed5b-46f6-b925-cb5c373f4cc6 req-d8457c07-d659-46d3-a069-30079408624d tempest-ServerRescueNegativeTestJSON-439221844 None] Deleting attachment b574aecb-cd8c-4368-b304-a0a4bd8ff65f. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:27:43.855353 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 27, 43, 748487)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:27:43.855794 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:27:43.856195 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Found cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Jul 16 21:27:43.872147 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" released by "_prepare_image_cache_entry" :: held 0.138s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:27:43.880936 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Attempting to retrieve cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Jul 16 21:27:43.914665 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 27, 43, 906003)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:27:43.918648 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:27:43.918648 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Creating from source image-volume b59b3901-b32a-4d92-81b0-6b99e88e4517 {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Jul 16 21:27:43.977158 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:44.249449 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] creating snapshot='volume-c4a6df28-c5be-4ffd-b735-00aefd2ae853.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:27:45.997388 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] cloning 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517@volume-c4a6df28-c5be-4ffd-b735-00aefd2ae853.clone_snap' to 'volume-c4a6df28-c5be-4ffd-b735-00aefd2ae853' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:27:46.010659 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=55,cinder:INSERT=5,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:27:46.011737 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=52,cinder:UPDATE=35,cinder:INSERT=7,cinder:DELETE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:27:47.890998 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945.deleted is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:27:47.890998 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:27:47.890998 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:27:48.395058 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:27:48.396752 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Marking volume c4a6df28-c5be-4ffd-b735-00aefd2ae853 as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:27:48.518509 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Copying metadata from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 to c4a6df28-c5be-4ffd-b735-00aefd2ae853. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Jul 16 21:27:48.522542 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Creating volume glance metadata for volume c4a6df28-c5be-4ffd-b735-00aefd2ae853 backed by image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131857) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Jul 16 21:27:48.654570 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5966ca3c-e41b-40fb-8b74-b45915804f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a6df28-c5be-4ffd-b735-00aefd2ae853', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9591a7bd60>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:27:48.661079 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f8f23b-42d0-4cb8-bb2f-4eca8a64a9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:27:48.775489 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Volume volume-c4a6df28-c5be-4ffd-b735-00aefd2ae853 (c4a6df28-c5be-4ffd-b735-00aefd2ae853): created successfully
Jul 16 21:27:48.779730 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f8f23b-42d0-4cb8-bb2f-4eca8a64a9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:27:48.785657 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Flow 'volume_create_manager' (63969887-1348-4420-8b1d-de67a5b56bff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:27:48.910050 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-8e2d0a52-e296-4822-8338-b7e3fe5a3fd2 tempest-VolumesBackupsTest-1570956956 None] Created volume successfully.
Jul 16 21:27:50.451287 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-665dc753-543e-4276-af1c-9df6cb4a1827 tempest-VolumesBackupsTest-1570956956 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-07-16T21:27:49Z,data_timestamp=2022-07-16T21:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1153048226',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=d202906a-1796-40b6-a258-373d1aaed398,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='7d5a798ee507429bb70566356229535d',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='bb1f6532421745a4b0de70356748a647',volume_id=c4a6df28-c5be-4ffd-b735-00aefd2ae853)
Jul 16 21:27:50.452067 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.backup.rpcapi [None req-665dc753-543e-4276-af1c-9df6cb4a1827 tempest-VolumesBackupsTest-1570956956 None] continue_backup in rpcapi backup_id d202906a-1796-40b6-a258-373d1aaed398 {{(pid=131857) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Jul 16 21:27:50.635837 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-665dc753-543e-4276-af1c-9df6cb4a1827 tempest-VolumesBackupsTest-1570956956 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:27:51.767448 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-665dc753-543e-4276-af1c-9df6cb4a1827 tempest-VolumesBackupsTest-1570956956 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.131s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:27:51.768593 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-665dc753-543e-4276-af1c-9df6cb4a1827 tempest-VolumesBackupsTest-1570956956 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c4a6df28-c5be-4ffd-b735-00aefd2ae853', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'c4a6df28-c5be-4ffd-b735-00aefd2ae853', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:27:51.802887 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-665dc753-543e-4276-af1c-9df6cb4a1827 tempest-VolumesBackupsTest-1570956956 None] Initialize volume connection completed successfully.
Jul 16 21:27:57.981087 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-993fe076-5b15-4e21-a53e-9ae8d08349f3 tempest-ServerRescueNegativeTestJSON-439221844 None] Acquiring lock "cinder-685a896a-62d9-4253-ae50-c46b14a0daf6-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:27:58.005845 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-993fe076-5b15-4e21-a53e-9ae8d08349f3 tempest-ServerRescueNegativeTestJSON-439221844 None] Lock "cinder-685a896a-62d9-4253-ae50-c46b14a0daf6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:27:58.158770 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-993fe076-5b15-4e21-a53e-9ae8d08349f3 tempest-ServerRescueNegativeTestJSON-439221844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:27:58.832393 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-993fe076-5b15-4e21-a53e-9ae8d08349f3 tempest-ServerRescueNegativeTestJSON-439221844 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:27:58.832847 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-993fe076-5b15-4e21-a53e-9ae8d08349f3 tempest-ServerRescueNegativeTestJSON-439221844 None] Volume volume-685a896a-62d9-4253-ae50-c46b14a0daf6 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:27:59.074645 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-993fe076-5b15-4e21-a53e-9ae8d08349f3 tempest-ServerRescueNegativeTestJSON-439221844 None] deleting rbd volume volume-685a896a-62d9-4253-ae50-c46b14a0daf6 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:28:08.155323 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=28,cinder:UPDATE=4,cinder:INSERT=12 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:28:09.712468 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-993fe076-5b15-4e21-a53e-9ae8d08349f3 tempest-ServerRescueNegativeTestJSON-439221844 None] Created reservations ['54f7e878-8e4a-4262-80f9-9720c926a562', 'a0ca843f-787c-46a6-888c-89e182cc8df8', 'b2112e3d-de57-402d-a751-d90651aa2685', 'e0f19eb4-2a4e-49a0-bae1-87edb1c7823a'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:28:09.972695 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-993fe076-5b15-4e21-a53e-9ae8d08349f3 tempest-ServerRescueNegativeTestJSON-439221844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:28:10.048554 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-993fe076-5b15-4e21-a53e-9ae8d08349f3 tempest-ServerRescueNegativeTestJSON-439221844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:28:10.122637 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-993fe076-5b15-4e21-a53e-9ae8d08349f3 tempest-ServerRescueNegativeTestJSON-439221844 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:28:10.131303 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-993fe076-5b15-4e21-a53e-9ae8d08349f3 tempest-ServerRescueNegativeTestJSON-439221844 None] Deleted volume successfully.
Jul 16 21:28:10.288339 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-993fe076-5b15-4e21-a53e-9ae8d08349f3 tempest-ServerRescueNegativeTestJSON-439221844 None] Lock "cinder-685a896a-62d9-4253-ae50-c46b14a0daf6-delete_volume" released by "delete_volume" :: held 12.289s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:28:10.596553 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-2ae39554-bb76-47be-8a76-1aac8c961aab tempest-ServerRescueNegativeTestJSON-439221844 None] Acquiring lock "cinder-48e72420-c2e0-466c-8349-298ea1959ee1-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:28:10.607771 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-2ae39554-bb76-47be-8a76-1aac8c961aab tempest-ServerRescueNegativeTestJSON-439221844 None] Lock "cinder-48e72420-c2e0-466c-8349-298ea1959ee1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:28:10.749086 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2ae39554-bb76-47be-8a76-1aac8c961aab tempest-ServerRescueNegativeTestJSON-439221844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:28:12.837252 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2ae39554-bb76-47be-8a76-1aac8c961aab tempest-ServerRescueNegativeTestJSON-439221844 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:28:12.840527 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2ae39554-bb76-47be-8a76-1aac8c961aab tempest-ServerRescueNegativeTestJSON-439221844 None] Volume volume-48e72420-c2e0-466c-8349-298ea1959ee1 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:28:13.146077 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2ae39554-bb76-47be-8a76-1aac8c961aab tempest-ServerRescueNegativeTestJSON-439221844 None] deleting rbd volume volume-48e72420-c2e0-466c-8349-298ea1959ee1 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:28:13.846790 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e83e49e7-ecc8-4369-87fd-b3ba9bfc8b3f tempest-VolumesNegativeTest-1381254418 None] Acquiring lock "cinder-662e1dcb-10c2-432a-8bc7-3eb95b75c0de-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:28:13.883073 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e83e49e7-ecc8-4369-87fd-b3ba9bfc8b3f tempest-VolumesNegativeTest-1381254418 None] Lock "cinder-662e1dcb-10c2-432a-8bc7-3eb95b75c0de-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:28:14.068021 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e83e49e7-ecc8-4369-87fd-b3ba9bfc8b3f tempest-VolumesNegativeTest-1381254418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:28:14.940574 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e83e49e7-ecc8-4369-87fd-b3ba9bfc8b3f tempest-VolumesNegativeTest-1381254418 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:28:14.945567 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e83e49e7-ecc8-4369-87fd-b3ba9bfc8b3f tempest-VolumesNegativeTest-1381254418 None] Volume volume-662e1dcb-10c2-432a-8bc7-3eb95b75c0de is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:28:15.319377 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e83e49e7-ecc8-4369-87fd-b3ba9bfc8b3f tempest-VolumesNegativeTest-1381254418 None] deleting rbd volume volume-662e1dcb-10c2-432a-8bc7-3eb95b75c0de {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:28:25.223954 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=40,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:28:25.398174 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-2ae39554-bb76-47be-8a76-1aac8c961aab tempest-ServerRescueNegativeTestJSON-439221844 None] Created reservations ['c3c8c1ce-e958-485b-82b0-5aa24fa2cf14', 'befc7099-03b3-4f3e-8fb7-68545bebfbf5', 'b249654c-074e-4f91-905b-09dd6f0b15b8', '893222dc-7d1a-4321-8b3a-b3fdf88089cc'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:28:25.731278 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2ae39554-bb76-47be-8a76-1aac8c961aab tempest-ServerRescueNegativeTestJSON-439221844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:28:25.817098 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2ae39554-bb76-47be-8a76-1aac8c961aab tempest-ServerRescueNegativeTestJSON-439221844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:28:25.898069 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-2ae39554-bb76-47be-8a76-1aac8c961aab tempest-ServerRescueNegativeTestJSON-439221844 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:28:25.904266 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-2ae39554-bb76-47be-8a76-1aac8c961aab tempest-ServerRescueNegativeTestJSON-439221844 None] Deleted volume successfully.
Jul 16 21:28:26.002289 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-2ae39554-bb76-47be-8a76-1aac8c961aab tempest-ServerRescueNegativeTestJSON-439221844 None] Lock "cinder-48e72420-c2e0-466c-8349-298ea1959ee1-delete_volume" released by "delete_volume" :: held 15.395s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:28:27.319914 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-e83e49e7-ecc8-4369-87fd-b3ba9bfc8b3f tempest-VolumesNegativeTest-1381254418 None] Created reservations ['8eb278c5-a871-4eef-a60d-6f5331a179df', '7cbbffb1-c1a8-4d75-ac59-776f819ec6fc', '90fd6ba0-5808-4089-843e-87af7ddf6219', '965adddd-29b5-474e-ba21-0df7792dba19'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:28:27.642441 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e83e49e7-ecc8-4369-87fd-b3ba9bfc8b3f tempest-VolumesNegativeTest-1381254418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:28:27.688038 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e83e49e7-ecc8-4369-87fd-b3ba9bfc8b3f tempest-VolumesNegativeTest-1381254418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:28:27.775852 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-e83e49e7-ecc8-4369-87fd-b3ba9bfc8b3f tempest-VolumesNegativeTest-1381254418 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:28:27.783908 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e83e49e7-ecc8-4369-87fd-b3ba9bfc8b3f tempest-VolumesNegativeTest-1381254418 None] Deleted volume successfully.
Jul 16 21:28:27.878457 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e83e49e7-ecc8-4369-87fd-b3ba9bfc8b3f tempest-VolumesNegativeTest-1381254418 None] Lock "cinder-662e1dcb-10c2-432a-8bc7-3eb95b75c0de-delete_volume" released by "delete_volume" :: held 13.996s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:28:35.437685 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:28:35.438394 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:28:35.522939 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:28:35.571342 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:28:37.791189 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=43,cinder:UPDATE=33,cinder:INSERT=8,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:28:47.131196 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-665dc753-543e-4276-af1c-9df6cb4a1827 tempest-VolumesBackupsTest-1570956956 None] Terminate volume connection completed successfully.
Jul 16 21:28:47.174549 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-665dc753-543e-4276-af1c-9df6cb4a1827 tempest-VolumesBackupsTest-1570956956 None] Remove volume export completed successfully.
Jul 16 21:28:49.306748 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:28:49.383164 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Flow 'volume_create_manager' (07f8405c-5c8e-4b6e-a90e-fbdd1f085a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:28:49.402818 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ccad8ee-4e2a-49f6-9684-a8a0c6d3748f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:28:49.437074 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ccad8ee-4e2a-49f6-9684-a8a0c6d3748f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:28:49Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_d202906a-1796-40b6-a258-373d1aaed398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=85b75ebc-8eac-4410-ab9e-70f35cd03f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a798ee507429bb70566356229535d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:28:49Z,use_quota=True,user_id='bb1f6532421745a4b0de70356748a647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:28:49.446582 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf84acc-b3a0-48fd-8667-a327d643e863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:28:49.453312 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf84acc-b3a0-48fd-8667-a327d643e863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:28:49.459931 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2cb485c-fd22-4fe1-9b67-e4d1c4a86506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:28:49.464278 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2cb485c-fd22-4fe1-9b67-e4d1c4a86506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85b75ebc-8eac-4410-ab9e-70f35cd03f63', 'volume_name': 'volume-85b75ebc-8eac-4410-ab9e-70f35cd03f63', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:28:49.470976 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f88b3f5-4ea5-4391-8ec2-ccbf78c2e497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:28:49.476367 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f88b3f5-4ea5-4391-8ec2-ccbf78c2e497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:28:49.483807 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cae5db7-5b85-4b86-8fb4-46baf06f439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:28:49.485637 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Volume 85b75ebc-8eac-4410-ab9e-70f35cd03f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85b75ebc-8eac-4410-ab9e-70f35cd03f63', 'volume_size': 1}
Jul 16 21:28:49.486861 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] creating volume 'volume-85b75ebc-8eac-4410-ab9e-70f35cd03f63' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:28:49.487834 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:28:50.481820 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:28:50.485693 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:28:50.487682 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cae5db7-5b85-4b86-8fb4-46baf06f439a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85b75ebc-8eac-4410-ab9e-70f35cd03f63', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:28:50.492589 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5d3e16-f6ae-4758-a0df-689204b0a54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:28:50.558589 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Volume volume-85b75ebc-8eac-4410-ab9e-70f35cd03f63 (85b75ebc-8eac-4410-ab9e-70f35cd03f63): created successfully
Jul 16 21:28:50.562390 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5d3e16-f6ae-4758-a0df-689204b0a54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:28:50.591109 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Flow 'volume_create_manager' (07f8405c-5c8e-4b6e-a90e-fbdd1f085a89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:28:50.688850 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Created volume successfully.
Jul 16 21:28:51.595282 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:28:53.209435 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.616s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:28:53.211210 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-85b75ebc-8eac-4410-ab9e-70f35cd03f63', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '85b75ebc-8eac-4410-ab9e-70f35cd03f63', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:28:53.267084 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Initialize volume connection completed successfully.
Jul 16 21:29:00.600402 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:29:00.695915 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:29:00.718050 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Flow 'volume_create_manager' (f2cb8934-396b-41da-97f9-8061df6e67c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:29:00.724289 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0937117-8f81-4abd-908b-656e588a0b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:00.743349 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0937117-8f81-4abd-908b-656e588a0b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-267737560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1aaa0726-b365-4d7a-8180-846786c1cfde,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9d2ef778592b4a7b8a721d0814f8f751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:29:00Z,use_quota=True,user_id='3b7f1205079b41428d9122e5c2d123dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:00.749319 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696de22c-4bf7-406b-a97f-8ff3a9e06dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:00.753677 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696de22c-4bf7-406b-a97f-8ff3a9e06dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:00.758735 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4270d73b-5379-4237-bf16-1e186e4d1c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:00.762794 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4270d73b-5379-4237-bf16-1e186e4d1c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aaa0726-b365-4d7a-8180-846786c1cfde', 'volume_name': 'volume-1aaa0726-b365-4d7a-8180-846786c1cfde', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:00.767655 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee335ee-8670-49ec-bc14-c1229257656f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:00.771525 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee335ee-8670-49ec-bc14-c1229257656f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:00.776188 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9298981b-cbad-4543-a6e2-fcb32192d68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:00.778251 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Volume 1aaa0726-b365-4d7a-8180-846786c1cfde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aaa0726-b365-4d7a-8180-846786c1cfde', 'volume_size': 1}
Jul 16 21:29:00.778251 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] creating volume 'volume-1aaa0726-b365-4d7a-8180-846786c1cfde' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:29:00.778468 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:29:03.607444 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:29:03.609289 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:29:03.615574 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9298981b-cbad-4543-a6e2-fcb32192d68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aaa0726-b365-4d7a-8180-846786c1cfde', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:03.620351 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f86a5c3-3b86-4a95-9452-5ce800f2c9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:03.728162 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Volume volume-1aaa0726-b365-4d7a-8180-846786c1cfde (1aaa0726-b365-4d7a-8180-846786c1cfde): created successfully
Jul 16 21:29:03.731966 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f86a5c3-3b86-4a95-9452-5ce800f2c9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:03.737890 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Flow 'volume_create_manager' (f2cb8934-396b-41da-97f9-8061df6e67c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:29:03.832208 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d528d6b7-53ab-4d07-a883-34fdb8ea8309 tempest-VolumesTestJSON-1603190450 None] Created volume successfully.
Jul 16 21:29:06.296867 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:29:06.337742 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Flow 'volume_create_manager' (d4af5830-9b50-421a-920e-fee23188c0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:29:06.346223 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5253a591-aae4-451f-a6dd-a45b8e04593b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:06.378471 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5253a591-aae4-451f-a6dd-a45b8e04593b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-581610433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=60002b45-60de-4193-9cc8-c089d98ce7ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9d2ef778592b4a7b8a721d0814f8f751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:29:06Z,use_quota=True,user_id='3b7f1205079b41428d9122e5c2d123dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:06.399609 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274e9dcd-711a-46fc-b40d-15d2cf35d6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:06.410985 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274e9dcd-711a-46fc-b40d-15d2cf35d6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:06.426119 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd752be-c40a-4fff-bc9f-af92f662a39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:06.446099 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd752be-c40a-4fff-bc9f-af92f662a39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60002b45-60de-4193-9cc8-c089d98ce7ba', 'volume_name': 'volume-60002b45-60de-4193-9cc8-c089d98ce7ba', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:06.469381 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f966320-4333-428f-b64d-587cb6b6b051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:06.474841 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f966320-4333-428f-b64d-587cb6b6b051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:06.480437 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d816715-2268-49e2-8179-75dc02938944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:06.485259 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Volume 60002b45-60de-4193-9cc8-c089d98ce7ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60002b45-60de-4193-9cc8-c089d98ce7ba', 'volume_size': 1}
Jul 16 21:29:06.489035 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] creating volume 'volume-60002b45-60de-4193-9cc8-c089d98ce7ba' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:29:06.489035 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:29:08.037325 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:29:08.038347 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:29:08.044178 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d816715-2268-49e2-8179-75dc02938944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60002b45-60de-4193-9cc8-c089d98ce7ba', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:08.051364 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f56170-3a4f-4322-b4fd-7ecf41e6bc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:08.201098 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Volume volume-60002b45-60de-4193-9cc8-c089d98ce7ba (60002b45-60de-4193-9cc8-c089d98ce7ba): created successfully
Jul 16 21:29:08.207406 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f56170-3a4f-4322-b4fd-7ecf41e6bc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:08.220248 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Flow 'volume_create_manager' (d4af5830-9b50-421a-920e-fee23188c0a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:29:08.386025 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-8346e45e-0333-40f8-8dc0-5bed191f23e5 tempest-VolumesTestJSON-1603190450 None] Created volume successfully.
Jul 16 21:29:10.316427 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:29:10.338174 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Flow 'volume_create_manager' (e72047c3-606f-4b93-b712-6812f2620341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:29:10.345656 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c35cf00-4787-4057-9f6a-fd4aa61e7317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:10.363392 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c35cf00-4787-4057-9f6a-fd4aa61e7317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-690226007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3a0b5ef1-5d7b-48c3-bb2d-db5fc3f57aad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9d2ef778592b4a7b8a721d0814f8f751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:29:10Z,use_quota=True,user_id='3b7f1205079b41428d9122e5c2d123dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:10.368580 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda2d128-2a09-4040-9d28-dc138e7b7e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:10.375173 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda2d128-2a09-4040-9d28-dc138e7b7e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:10.379062 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d34c1f-8fd6-4207-a254-685e9e40bb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:10.383291 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d34c1f-8fd6-4207-a254-685e9e40bb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a0b5ef1-5d7b-48c3-bb2d-db5fc3f57aad', 'volume_name': 'volume-3a0b5ef1-5d7b-48c3-bb2d-db5fc3f57aad', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:10.388878 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d249cb8-effe-4823-a8d3-1d2af4871c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:10.392769 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d249cb8-effe-4823-a8d3-1d2af4871c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:10.397369 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c9c3ab-b701-4d25-b5e8-9de39362f7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:10.398405 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Volume 3a0b5ef1-5d7b-48c3-bb2d-db5fc3f57aad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a0b5ef1-5d7b-48c3-bb2d-db5fc3f57aad', 'volume_size': 1}
Jul 16 21:29:10.398811 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] creating volume 'volume-3a0b5ef1-5d7b-48c3-bb2d-db5fc3f57aad' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:29:10.399453 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:29:12.832240 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:29:12.832925 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:29:12.836773 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c9c3ab-b701-4d25-b5e8-9de39362f7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a0b5ef1-5d7b-48c3-bb2d-db5fc3f57aad', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:12.844344 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef12fb4f-7183-4b63-9759-8307116d8d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:12.961216 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Volume volume-3a0b5ef1-5d7b-48c3-bb2d-db5fc3f57aad (3a0b5ef1-5d7b-48c3-bb2d-db5fc3f57aad): created successfully
Jul 16 21:29:12.968079 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef12fb4f-7183-4b63-9759-8307116d8d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:12.974470 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Flow 'volume_create_manager' (e72047c3-606f-4b93-b712-6812f2620341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:29:12.979046 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=28,cinder:UPDATE=6,cinder:DELETE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:29:13.098811 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-083cea00-dc39-4de8-bc48-ded33c439011 tempest-VolumesTestJSON-1603190450 None] Created volume successfully.
Jul 16 21:29:14.644093 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b4c1c055-3d09-43cd-b462-acc17bf0e727 tempest-VolumesTestJSON-1603190450 None] Acquiring lock "cinder-3a0b5ef1-5d7b-48c3-bb2d-db5fc3f57aad-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:29:14.671596 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b4c1c055-3d09-43cd-b462-acc17bf0e727 tempest-VolumesTestJSON-1603190450 None] Lock "cinder-3a0b5ef1-5d7b-48c3-bb2d-db5fc3f57aad-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:29:14.842858 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4c1c055-3d09-43cd-b462-acc17bf0e727 tempest-VolumesTestJSON-1603190450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:29:15.613537 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4c1c055-3d09-43cd-b462-acc17bf0e727 tempest-VolumesTestJSON-1603190450 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:29:15.613537 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4c1c055-3d09-43cd-b462-acc17bf0e727 tempest-VolumesTestJSON-1603190450 None] Volume volume-3a0b5ef1-5d7b-48c3-bb2d-db5fc3f57aad is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:29:16.033374 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4c1c055-3d09-43cd-b462-acc17bf0e727 tempest-VolumesTestJSON-1603190450 None] deleting rbd volume volume-3a0b5ef1-5d7b-48c3-bb2d-db5fc3f57aad {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:29:17.073605 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:29:17.120862 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Flow 'volume_create_manager' (8d175cab-5ca9-4a94-977e-09f977ea2021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:29:17.129339 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504bf1bc-e68c-496b-99f1-8f03458f9ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:17.167053 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504bf1bc-e68c-496b-99f1-8f03458f9ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1722723111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e451ee7bfd2d4ab58d30c33fef334b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:29:17Z,use_quota=True,user_id='ca2c9e7e6d61414cbf2c7e17753bc0df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:17.183540 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994e533e-41e5-4939-9258-76fdf4082172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:17.188480 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994e533e-41e5-4939-9258-76fdf4082172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:17.195398 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (179f66fc-c17b-47fe-83fa-df052868ca8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:17.201701 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (179f66fc-c17b-47fe-83fa-df052868ca8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813', 'volume_name': 'volume-18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:17.207253 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4abbe5-94c6-4d56-824d-0e33d7d8bd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:17.221986 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4abbe5-94c6-4d56-824d-0e33d7d8bd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:17.227104 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6f3c7e-0862-4472-8b30-43fdcbbde19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:17.234143 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Volume 18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813', 'volume_size': 1}
Jul 16 21:29:17.234754 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] creating volume 'volume-18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:29:17.235608 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:29:18.876717 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:29:18.877393 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:29:18.883282 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6f3c7e-0862-4472-8b30-43fdcbbde19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:18.888092 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fa0782-6a8d-4954-9a79-a37183e68584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:29:19.035892 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Volume volume-18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813 (18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813): created successfully
Jul 16 21:29:19.040366 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fa0782-6a8d-4954-9a79-a37183e68584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:29:19.049472 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Flow 'volume_create_manager' (8d175cab-5ca9-4a94-977e-09f977ea2021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:29:19.208363 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-c8739947-0b7d-44fa-95d7-4b9d574e1bc6 tempest-AttachVolumeShelveTestJSON-2044012735 None] Created volume successfully.
Jul 16 21:29:26.711739 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-b4c1c055-3d09-43cd-b462-acc17bf0e727 tempest-VolumesTestJSON-1603190450 None] Created reservations ['e131c3c8-9b9a-4ac9-8550-5c2806881742', '0a1901f3-5e91-43a8-bf97-f9cd692e4825', '9daaaafb-820a-4e32-9442-8eda5dd21660', '666b92fe-1c48-421c-a78c-845aff20d4e6'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:29:26.979190 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4c1c055-3d09-43cd-b462-acc17bf0e727 tempest-VolumesTestJSON-1603190450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:29:27.028674 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4c1c055-3d09-43cd-b462-acc17bf0e727 tempest-VolumesTestJSON-1603190450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:29:27.082071 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-b4c1c055-3d09-43cd-b462-acc17bf0e727 tempest-VolumesTestJSON-1603190450 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:29:27.083496 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b4c1c055-3d09-43cd-b462-acc17bf0e727 tempest-VolumesTestJSON-1603190450 None] Deleted volume successfully.
Jul 16 21:29:27.223273 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b4c1c055-3d09-43cd-b462-acc17bf0e727 tempest-VolumesTestJSON-1603190450 None] Lock "cinder-3a0b5ef1-5d7b-48c3-bb2d-db5fc3f57aad-delete_volume" released by "delete_volume" :: held 12.552s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:29:28.093493 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3c78e7b3-fdec-478c-b87e-324785d4e1ed tempest-VolumesTestJSON-1603190450 None] Acquiring lock "cinder-60002b45-60de-4193-9cc8-c089d98ce7ba-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:29:28.117867 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3c78e7b3-fdec-478c-b87e-324785d4e1ed tempest-VolumesTestJSON-1603190450 None] Lock "cinder-60002b45-60de-4193-9cc8-c089d98ce7ba-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:29:28.269100 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3c78e7b3-fdec-478c-b87e-324785d4e1ed tempest-VolumesTestJSON-1603190450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:29:28.721366 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3c78e7b3-fdec-478c-b87e-324785d4e1ed tempest-VolumesTestJSON-1603190450 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:29:28.725547 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3c78e7b3-fdec-478c-b87e-324785d4e1ed tempest-VolumesTestJSON-1603190450 None] Volume volume-60002b45-60de-4193-9cc8-c089d98ce7ba is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:29:29.098680 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3c78e7b3-fdec-478c-b87e-324785d4e1ed tempest-VolumesTestJSON-1603190450 None] deleting rbd volume volume-60002b45-60de-4193-9cc8-c089d98ce7ba {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:29:35.446510 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:29:35.447462 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:29:35.670075 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:29:35.770144 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:29:36.051611 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=38,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:29:41.091469 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-3c78e7b3-fdec-478c-b87e-324785d4e1ed tempest-VolumesTestJSON-1603190450 None] Created reservations ['1ae6c6df-9d76-42b5-8a5a-28a8ed179f65', '45f0bd17-2f81-4b75-a39e-19deb864616f', '739ccfa1-f648-40ab-801c-2cf183222e93', 'f85831d1-0673-4ec3-a37d-65ca24698429'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:29:41.432859 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3c78e7b3-fdec-478c-b87e-324785d4e1ed tempest-VolumesTestJSON-1603190450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:29:41.503129 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3c78e7b3-fdec-478c-b87e-324785d4e1ed tempest-VolumesTestJSON-1603190450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:29:41.584352 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-3c78e7b3-fdec-478c-b87e-324785d4e1ed tempest-VolumesTestJSON-1603190450 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:29:41.601317 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-3c78e7b3-fdec-478c-b87e-324785d4e1ed tempest-VolumesTestJSON-1603190450 None] Deleted volume successfully.
Jul 16 21:29:41.835233 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3c78e7b3-fdec-478c-b87e-324785d4e1ed tempest-VolumesTestJSON-1603190450 None] Lock "cinder-60002b45-60de-4193-9cc8-c089d98ce7ba-delete_volume" released by "delete_volume" :: held 13.719s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:29:42.597975 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-fc5c2d70-d210-42b8-b7f4-d9c5e779c200 tempest-VolumesTestJSON-1603190450 None] Acquiring lock "cinder-1aaa0726-b365-4d7a-8180-846786c1cfde-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:29:42.616591 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-fc5c2d70-d210-42b8-b7f4-d9c5e779c200 tempest-VolumesTestJSON-1603190450 None] Lock "cinder-1aaa0726-b365-4d7a-8180-846786c1cfde-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:29:42.747831 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-fc5c2d70-d210-42b8-b7f4-d9c5e779c200 tempest-VolumesTestJSON-1603190450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:29:43.132880 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-fc5c2d70-d210-42b8-b7f4-d9c5e779c200 tempest-VolumesTestJSON-1603190450 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:29:43.133677 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-fc5c2d70-d210-42b8-b7f4-d9c5e779c200 tempest-VolumesTestJSON-1603190450 None] Volume volume-1aaa0726-b365-4d7a-8180-846786c1cfde is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:29:43.459334 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-fc5c2d70-d210-42b8-b7f4-d9c5e779c200 tempest-VolumesTestJSON-1603190450 None] deleting rbd volume volume-1aaa0726-b365-4d7a-8180-846786c1cfde {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:29:46.047261 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=35,cinder:UPDATE=19,cinder:INSERT=2,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:29:51.687462 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Terminate volume connection completed successfully.
Jul 16 21:29:51.716558 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d13d73eb-72b6-48c7-b288-8aee017a436e tempest-VolumesBackupsTest-1570956956 None] Remove volume export completed successfully.
Jul 16 21:29:52.532695 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-fc5c2d70-d210-42b8-b7f4-d9c5e779c200 tempest-VolumesTestJSON-1603190450 None] Created reservations ['9c3ea867-608a-4518-ab21-5316cc3c8fab', '7854e7c6-e200-45a7-aaad-9b7e44a130a4', '253735c1-e8d8-4606-8dd9-8e808c1a6eb9', 'df5cbf61-7f42-417e-92d8-1292c1d9d0d9'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:29:52.849212 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-fc5c2d70-d210-42b8-b7f4-d9c5e779c200 tempest-VolumesTestJSON-1603190450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:29:52.945089 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-fc5c2d70-d210-42b8-b7f4-d9c5e779c200 tempest-VolumesTestJSON-1603190450 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:29:53.046393 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-fc5c2d70-d210-42b8-b7f4-d9c5e779c200 tempest-VolumesTestJSON-1603190450 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:29:53.066752 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-fc5c2d70-d210-42b8-b7f4-d9c5e779c200 tempest-VolumesTestJSON-1603190450 None] Deleted volume successfully.
Jul 16 21:29:53.236529 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-fc5c2d70-d210-42b8-b7f4-d9c5e779c200 tempest-VolumesTestJSON-1603190450 None] Lock "cinder-1aaa0726-b365-4d7a-8180-846786c1cfde-delete_volume" released by "delete_volume" :: held 10.620s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:29:53.488762 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-49f4de7c-2a45-4b6c-8417-34f0ce91ebc8 tempest-VolumesBackupsTest-1570956956 None] Acquiring lock "cinder-85b75ebc-8eac-4410-ab9e-70f35cd03f63-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:29:53.513500 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-49f4de7c-2a45-4b6c-8417-34f0ce91ebc8 tempest-VolumesBackupsTest-1570956956 None] Lock "cinder-85b75ebc-8eac-4410-ab9e-70f35cd03f63-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:29:53.641292 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-49f4de7c-2a45-4b6c-8417-34f0ce91ebc8 tempest-VolumesBackupsTest-1570956956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:29:57.377133 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-49f4de7c-2a45-4b6c-8417-34f0ce91ebc8 tempest-VolumesBackupsTest-1570956956 None] Volume volume-85b75ebc-8eac-4410-ab9e-70f35cd03f63 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:29:58.321696 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-49f4de7c-2a45-4b6c-8417-34f0ce91ebc8 tempest-VolumesBackupsTest-1570956956 None] deleting rbd volume volume-85b75ebc-8eac-4410-ab9e-70f35cd03f63 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:30:08.836737 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-9815d312-f70d-4dd6-9156-faf56f2a9989 req-e11591b4-557e-40e6-ad1a-aa32cff5d6f2 tempest-AttachVolumeShelveTestJSON-2044012735 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:30:10.019600 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-9815d312-f70d-4dd6-9156-faf56f2a9989 req-e11591b4-557e-40e6-ad1a-aa32cff5d6f2 tempest-AttachVolumeShelveTestJSON-2044012735 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.182s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:30:10.020412 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-9815d312-f70d-4dd6-9156-faf56f2a9989 req-e11591b4-557e-40e6-ad1a-aa32cff5d6f2 tempest-AttachVolumeShelveTestJSON-2044012735 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:30:10.042323 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=33,cinder:INSERT=7,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:30:10.142698 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-9815d312-f70d-4dd6-9156-faf56f2a9989 req-e11591b4-557e-40e6-ad1a-aa32cff5d6f2 tempest-AttachVolumeShelveTestJSON-2044012735 None] Connection info returned from driver {'name': 'volumes/volume-18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b2997727-dcd0-4162-8f01-fe31df8ff29c'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:30:10.361886 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-9815d312-f70d-4dd6-9156-faf56f2a9989 req-e11591b4-557e-40e6-ad1a-aa32cff5d6f2 tempest-AttachVolumeShelveTestJSON-2044012735 None] attachment_update completed successfully.
Jul 16 21:30:11.596588 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-49f4de7c-2a45-4b6c-8417-34f0ce91ebc8 tempest-VolumesBackupsTest-1570956956 None] Created reservations ['3d6f8696-3fe0-48a4-82d7-852aa6470dd8', '2a2935c1-a1f7-42c3-8323-4f17989d4816', '4897aabe-f528-498d-8235-e54bc5bd2ac9', '7316c347-9ad0-4273-99c8-345f32c8866d'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:30:11.945078 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-49f4de7c-2a45-4b6c-8417-34f0ce91ebc8 tempest-VolumesBackupsTest-1570956956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:30:12.041798 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-49f4de7c-2a45-4b6c-8417-34f0ce91ebc8 tempest-VolumesBackupsTest-1570956956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:30:12.128855 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-49f4de7c-2a45-4b6c-8417-34f0ce91ebc8 tempest-VolumesBackupsTest-1570956956 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:30:12.138439 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-49f4de7c-2a45-4b6c-8417-34f0ce91ebc8 tempest-VolumesBackupsTest-1570956956 None] Deleted volume successfully.
Jul 16 21:30:12.251277 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-49f4de7c-2a45-4b6c-8417-34f0ce91ebc8 tempest-VolumesBackupsTest-1570956956 None] Lock "cinder-85b75ebc-8eac-4410-ab9e-70f35cd03f63-delete_volume" released by "delete_volume" :: held 18.732s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:30:28.343701 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:30:28.344663 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=54,cinder:INSERT=5,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:30:31.987800 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-d9e68763-4f72-47f6-a05b-481f51c730fb tempest-VolumesBackupsTest-1570956956 None] Acquiring lock "cinder-c4a6df28-c5be-4ffd-b735-00aefd2ae853-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:30:32.004341 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-d9e68763-4f72-47f6-a05b-481f51c730fb tempest-VolumesBackupsTest-1570956956 None] Lock "cinder-c4a6df28-c5be-4ffd-b735-00aefd2ae853-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:30:32.163711 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d9e68763-4f72-47f6-a05b-481f51c730fb tempest-VolumesBackupsTest-1570956956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:30:36.779221 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d9e68763-4f72-47f6-a05b-481f51c730fb tempest-VolumesBackupsTest-1570956956 None] deleting rbd volume volume-c4a6df28-c5be-4ffd-b735-00aefd2ae853 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:30:36.779221 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:30:36.779221 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:30:36.853912 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:30:36.928214 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:30:42.162479 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:30:45.263089 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d9e68763-4f72-47f6-a05b-481f51c730fb tempest-VolumesBackupsTest-1570956956 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:30:45.483256 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d9e68763-4f72-47f6-a05b-481f51c730fb tempest-VolumesBackupsTest-1570956956 None] deleting parent snapshot volume-c4a6df28-c5be-4ffd-b735-00aefd2ae853.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:30:50.255423 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:30:50.479345 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-d9e68763-4f72-47f6-a05b-481f51c730fb tempest-VolumesBackupsTest-1570956956 None] Created reservations ['fd642557-afaa-41e9-aea2-3e7a27fe95dc', '5bee8089-d397-4c53-8572-5e01671c83aa', '37f3bed8-4d6b-481b-a654-973ce2656a62', '06d4a570-74c3-41e5-b843-ba97a6d2d692'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:30:50.758490 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d9e68763-4f72-47f6-a05b-481f51c730fb tempest-VolumesBackupsTest-1570956956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:30:50.837148 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d9e68763-4f72-47f6-a05b-481f51c730fb tempest-VolumesBackupsTest-1570956956 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:30:50.899796 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-d9e68763-4f72-47f6-a05b-481f51c730fb tempest-VolumesBackupsTest-1570956956 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:30:50.905780 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d9e68763-4f72-47f6-a05b-481f51c730fb tempest-VolumesBackupsTest-1570956956 None] Deleted volume successfully.
Jul 16 21:30:51.036193 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-d9e68763-4f72-47f6-a05b-481f51c730fb tempest-VolumesBackupsTest-1570956956 None] Lock "cinder-c4a6df28-c5be-4ffd-b735-00aefd2ae853-delete_volume" released by "delete_volume" :: held 19.032s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:31:20.263067 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=23,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:31:20.586941 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-6132a5a0-1793-4887-82ef-846badb6d6a3 req-e7084e11-5da9-4d3b-b91d-bcf492f9f5c8 tempest-AttachVolumeShelveTestJSON-2044012735 None] Terminate volume connection completed successfully.
Jul 16 21:31:20.587962 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-6132a5a0-1793-4887-82ef-846badb6d6a3 req-e7084e11-5da9-4d3b-b91d-bcf492f9f5c8 tempest-AttachVolumeShelveTestJSON-2044012735 None] Deleting attachment b2997727-dcd0-4162-8f01-fe31df8ff29c. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:31:30.271432 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:31:36.774553 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:31:36.775769 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:31:36.868188 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:31:36.931958 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:31:40.296089 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:32:10.277827 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:32:10.280039 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:32:15.678213 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-5930930f-2295-4592-8691-593c499f4844 tempest-GroupSnapshotsTest-2121718510 None] Group tempest-GroupSnapshotsTest-Group-1586871330: creating
Jul 16 21:32:15.876841 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-5930930f-2295-4592-8691-593c499f4844 tempest-GroupSnapshotsTest-2121718510 None] Group tempest-GroupSnapshotsTest-Group-1586871330: created successfully
Jul 16 21:32:15.891315 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-5930930f-2295-4592-8691-593c499f4844 tempest-GroupSnapshotsTest-2121718510 None] Create group completed successfully.
Jul 16 21:32:18.367425 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:32:18.414900 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Flow 'volume_create_manager' (aa548e20-1cc9-4aa0-a6c2-a69446bef0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:32:18.433800 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3571662-e9de-42f4-b812-7f0b9ab182e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:18.455843 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3571662-e9de-42f4-b812-7f0b9ab182e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-920361488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=334a46b8-951f-45ae-b211-879e9db2756c,host='ncdv-master-1@ceph#ceph',id=da9de8eb-64f4-4cd4-b677-60c843dbb26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d6ad3663924aa3a52b865623907f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:32:18Z,use_quota=True,user_id='4757098bb5a64b1990b95f97e1ab9493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc9aaf37-a21e-4cf5-adca-f998e2b7f5e7),volume_type_id=bc9aaf37-a21e-4cf5-adca-f998e2b7f5e7)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:18.461860 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57802568-ab2f-417b-8bd9-82dea71ca1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:18.466375 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57802568-ab2f-417b-8bd9-82dea71ca1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:18.473152 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9f8c5e-fdbd-473b-a760-60d54c6d6ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:18.477793 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9f8c5e-fdbd-473b-a760-60d54c6d6ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da9de8eb-64f4-4cd4-b677-60c843dbb26a', 'volume_name': 'volume-da9de8eb-64f4-4cd4-b677-60c843dbb26a', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:18.483129 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcc7464-4b0d-4b03-ac83-cef87514eedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:18.487174 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcc7464-4b0d-4b03-ac83-cef87514eedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:18.492165 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa752cd-f7f2-4bed-be9c-56e152f892fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:18.493630 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Volume da9de8eb-64f4-4cd4-b677-60c843dbb26a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da9de8eb-64f4-4cd4-b677-60c843dbb26a', 'volume_size': 1}
Jul 16 21:32:18.494299 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] creating volume 'volume-da9de8eb-64f4-4cd4-b677-60c843dbb26a' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:32:18.495344 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:32:19.604244 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] extra_specs: {} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:32:19.605789 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] extra_specs: {} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:32:19.612018 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa752cd-f7f2-4bed-be9c-56e152f892fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da9de8eb-64f4-4cd4-b677-60c843dbb26a', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:19.624429 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fca3b09-0362-4b23-b51f-d7e85dde1411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:19.689015 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Volume volume-da9de8eb-64f4-4cd4-b677-60c843dbb26a (da9de8eb-64f4-4cd4-b677-60c843dbb26a): created successfully
Jul 16 21:32:19.719263 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fca3b09-0362-4b23-b51f-d7e85dde1411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:19.734812 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Flow 'volume_create_manager' (aa548e20-1cc9-4aa0-a6c2-a69446bef0b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:32:19.828814 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-018d316b-e893-4df6-90ed-cf55f943a633 tempest-GroupSnapshotsTest-2121718510 None] Created volume successfully.
Jul 16 21:32:21.268656 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-c43f0ad8-5f47-449d-b8a8-b8d28944b9ab tempest-GroupSnapshotsTest-2121718510 None] GroupSnapshot 6e2e352d-bb5d-4659-aa77-5961c48c9719: creating.
Jul 16 21:32:21.309452 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c43f0ad8-5f47-449d-b8a8-b8d28944b9ab tempest-GroupSnapshotsTest-2121718510 None] Group snapshot 6e2e352d-bb5d-4659-aa77-5961c48c9719: creating. {{(pid=131857) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4081}}
Jul 16 21:32:21.338105 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c43f0ad8-5f47-449d-b8a8-b8d28944b9ab tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:32:26.416812 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-c43f0ad8-5f47-449d-b8a8-b8d28944b9ab tempest-GroupSnapshotsTest-2121718510 None] group_snapshot 6e2e352d-bb5d-4659-aa77-5961c48c9719: created successfully
Jul 16 21:32:28.012759 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-14b3f977-8c97-4ecd-abc9-729b4c1776a1 tempest-GroupSnapshotsTest-2121718510 None] cloning volumes/volume-da9de8eb-64f4-4cd4-b677-60c843dbb26a@snapshot-ce5bcd7e-e35a-4e6e-9466-80799995902a to volume-a1fbffc3-3545-4d86-acc8-73aeaa4efc0b {{(pid=131857) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}}
Jul 16 21:32:28.014382 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-14b3f977-8c97-4ecd-abc9-729b4c1776a1 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:32:28.125658 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-14b3f977-8c97-4ecd-abc9-729b4c1776a1 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:32:31.101106 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-14b3f977-8c97-4ecd-abc9-729b4c1776a1 tempest-GroupSnapshotsTest-2121718510 None] extra_specs: {} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:32:31.102013 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-14b3f977-8c97-4ecd-abc9-729b4c1776a1 tempest-GroupSnapshotsTest-2121718510 None] extra_specs: {} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:32:31.112929 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-14b3f977-8c97-4ecd-abc9-729b4c1776a1 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:32:31.186907 ncdv-master-1 cinder-volume[131857]: WARNING cinder.volume.drivers.rbd [None req-14b3f977-8c97-4ecd-abc9-729b4c1776a1 tempest-GroupSnapshotsTest-2121718510 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError
Jul 16 21:32:31.907536 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-14b3f977-8c97-4ecd-abc9-729b4c1776a1 tempest-GroupSnapshotsTest-2121718510 None] Create group from source-snapshot-6e2e352d-bb5d-4659-aa77-5961c48c9719 completed successfully.
Jul 16 21:32:32.189380 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-efec2424-e73f-4563-8758-206689000c1f tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:32:32.538889 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-efec2424-e73f-4563-8758-206689000c1f tempest-GroupSnapshotsTest-2121718510 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:32:32.780618 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-efec2424-e73f-4563-8758-206689000c1f tempest-GroupSnapshotsTest-2121718510 None] deleting rbd volume volume-a1fbffc3-3545-4d86-acc8-73aeaa4efc0b {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:32:36.770278 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:32:36.771865 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:32:36.893960 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:32:36.991807 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:32:39.835271 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-efec2424-e73f-4563-8758-206689000c1f tempest-GroupSnapshotsTest-2121718510 None] Created reservations ['ae086c14-8d64-4507-ba09-739716617f03'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:32:39.885229 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-efec2424-e73f-4563-8758-206689000c1f tempest-GroupSnapshotsTest-2121718510 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1200286816 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1200286816, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:32:39.886958 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-efec2424-e73f-4563-8758-206689000c1f tempest-GroupSnapshotsTest-2121718510 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1200286816 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1200286816, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:32:39.979054 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-efec2424-e73f-4563-8758-206689000c1f tempest-GroupSnapshotsTest-2121718510 None] Created reservations ['fdcec4fe-fa02-4243-a249-24868ed835bd', '49e4b585-9309-4f52-9d81-903cceff7aa6', 'b2b56cd9-61d6-4e9a-a428-3b1c461c80ff', 'aab3e21c-ee58-4686-90fb-83ab6885b287'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:32:40.602244 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-efec2424-e73f-4563-8758-206689000c1f tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:32:40.644917 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-efec2424-e73f-4563-8758-206689000c1f tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:32:40.747159 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-efec2424-e73f-4563-8758-206689000c1f tempest-GroupSnapshotsTest-2121718510 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:32:40.757137 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-efec2424-e73f-4563-8758-206689000c1f tempest-GroupSnapshotsTest-2121718510 None] Delete group completed successfully.
Jul 16 21:32:41.492297 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-0ff0973a-f966-42f8-94ff-87dd3176e180 tempest-GroupSnapshotsTest-2121718510 None] group_snapshot 6e2e352d-bb5d-4659-aa77-5961c48c9719: deleting
Jul 16 21:32:41.508734 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=62,cinder:UPDATE=26,cinder:INSERT=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:32:41.517313 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0ff0973a-f966-42f8-94ff-87dd3176e180 tempest-GroupSnapshotsTest-2121718510 None] group_snapshot 6e2e352d-bb5d-4659-aa77-5961c48c9719: deleting {{(pid=131857) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4256}}
Jul 16 21:32:41.542626 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0ff0973a-f966-42f8-94ff-87dd3176e180 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:32:43.916092 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=55,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:32:44.029262 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:32:44.048790 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Flow 'volume_create_manager' (05004169-7b61-45ed-9042-f1045350d219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:32:44.055559 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8816205-abcf-4bea-810d-86ff59994dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:44.071556 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8816205-abcf-4bea-810d-86ff59994dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2077146112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3ac2d5bc-2859-4330-aaae-14914ce01b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e451ee7bfd2d4ab58d30c33fef334b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:32:44Z,use_quota=True,user_id='ca2c9e7e6d61414cbf2c7e17753bc0df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:44.076714 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18133745-c917-4398-9bbd-56fb2f8e8f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:44.080775 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18133745-c917-4398-9bbd-56fb2f8e8f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:44.085717 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4aa4637-7bdc-48df-9a5c-2da5f42f88f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:44.089688 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4aa4637-7bdc-48df-9a5c-2da5f42f88f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac2d5bc-2859-4330-aaae-14914ce01b8a', 'volume_name': 'volume-3ac2d5bc-2859-4330-aaae-14914ce01b8a', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:44.094454 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e0470c-97f5-40ba-bd8a-39308b93d19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:44.098504 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e0470c-97f5-40ba-bd8a-39308b93d19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:44.108313 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5c5148-8d06-4cb6-a232-c4a72e09b440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:44.108313 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Volume 3ac2d5bc-2859-4330-aaae-14914ce01b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac2d5bc-2859-4330-aaae-14914ce01b8a', 'volume_size': 1}
Jul 16 21:32:44.108313 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] creating volume 'volume-3ac2d5bc-2859-4330-aaae-14914ce01b8a' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:32:44.108313 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:32:45.051753 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:32:45.052523 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:32:45.058769 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5c5148-8d06-4cb6-a232-c4a72e09b440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac2d5bc-2859-4330-aaae-14914ce01b8a', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:45.088231 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1655ef-90da-47ec-a2d8-a1dfd7e994d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:45.172776 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Volume volume-3ac2d5bc-2859-4330-aaae-14914ce01b8a (3ac2d5bc-2859-4330-aaae-14914ce01b8a): created successfully
Jul 16 21:32:45.179751 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1655ef-90da-47ec-a2d8-a1dfd7e994d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:45.185280 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Flow 'volume_create_manager' (05004169-7b61-45ed-9042-f1045350d219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:32:45.279179 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-04c490a1-22c3-410d-94b0-fb773283d82a tempest-AttachVolumeShelveTestJSON-2044012735 None] Created volume successfully.
Jul 16 21:32:45.356748 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-0ff0973a-f966-42f8-94ff-87dd3176e180 tempest-GroupSnapshotsTest-2121718510 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1200286816 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1200286816, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:32:45.544817 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-0ff0973a-f966-42f8-94ff-87dd3176e180 tempest-GroupSnapshotsTest-2121718510 None] Created reservations ['aa356476-651d-4acd-9965-078977395332', '72f7eff2-0629-492d-b1ff-7711ff4de69d', 'dcb35b10-fdf5-491c-b802-7d0ce4fee68d', '4d47cce8-5150-435d-8679-0570d275468b'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:32:45.928602 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-0ff0973a-f966-42f8-94ff-87dd3176e180 tempest-GroupSnapshotsTest-2121718510 None] group_snapshot 6e2e352d-bb5d-4659-aa77-5961c48c9719: deleted successfully
Jul 16 21:32:47.477537 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c5daccb3-7114-4b2c-ba89-363522c50858 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:32:47.886461 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c5daccb3-7114-4b2c-ba89-363522c50858 tempest-GroupSnapshotsTest-2121718510 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:32:47.887408 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c5daccb3-7114-4b2c-ba89-363522c50858 tempest-GroupSnapshotsTest-2121718510 None] Volume volume-da9de8eb-64f4-4cd4-b677-60c843dbb26a is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:32:48.028649 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c5daccb3-7114-4b2c-ba89-363522c50858 tempest-GroupSnapshotsTest-2121718510 None] deleting rbd volume volume-da9de8eb-64f4-4cd4-b677-60c843dbb26a {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:32:54.274060 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-c5daccb3-7114-4b2c-ba89-363522c50858 tempest-GroupSnapshotsTest-2121718510 None] Created reservations ['c3c45551-11cd-45f6-bc37-55740524eb1a'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:32:54.345027 ncdv-master-1 cinder-volume[131857]: WARNING cinder.db.sqlalchemy.api [None req-c5daccb3-7114-4b2c-ba89-363522c50858 tempest-GroupSnapshotsTest-2121718510 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1200286816']
Jul 16 21:32:54.425592 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-c5daccb3-7114-4b2c-ba89-363522c50858 tempest-GroupSnapshotsTest-2121718510 None] Created reservations ['c95dc71b-ee15-471c-bdf8-36a93f4fec5b', '2ca560ae-4254-4bc2-8990-46fe65bbbd22', 'd008b51c-df7c-4e28-9c34-9c247e4a090b', '3aa01a25-5a0b-4a42-8d4a-cfc49fdd05a5'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:32:54.992150 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c5daccb3-7114-4b2c-ba89-363522c50858 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:32:55.039046 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c5daccb3-7114-4b2c-ba89-363522c50858 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:32:55.113729 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-c5daccb3-7114-4b2c-ba89-363522c50858 tempest-GroupSnapshotsTest-2121718510 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:32:55.120287 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-c5daccb3-7114-4b2c-ba89-363522c50858 tempest-GroupSnapshotsTest-2121718510 None] Delete group completed successfully.
Jul 16 21:32:56.291424 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-2cc6d246-0e3f-43b8-bcf8-bb685cbeccfa tempest-GroupSnapshotsTest-2121718510 None] Group tempest-GroupSnapshotsTest-Group-28275986: creating
Jul 16 21:32:56.399153 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-2cc6d246-0e3f-43b8-bcf8-bb685cbeccfa tempest-GroupSnapshotsTest-2121718510 None] Group tempest-GroupSnapshotsTest-Group-28275986: created successfully
Jul 16 21:32:56.432261 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-2cc6d246-0e3f-43b8-bcf8-bb685cbeccfa tempest-GroupSnapshotsTest-2121718510 None] Create group completed successfully.
Jul 16 21:32:58.715548 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:32:58.782480 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Flow 'volume_create_manager' (589544d4-db18-45c3-a869-698a6f4929fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:32:58.790632 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d17e16-37d1-46c0-a451-25d4927c2fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:58.817302 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d17e16-37d1-46c0-a451-25d4927c2fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-819227018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f5d0d878-e06e-4eed-9e2f-3ac78b444fa2,host='ncdv-master-1@ceph#ceph',id=cd64149e-7b71-45a0-8326-050dd4f70397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d6ad3663924aa3a52b865623907f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:32:58Z,use_quota=True,user_id='4757098bb5a64b1990b95f97e1ab9493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61d8b57f-90ce-4194-b01d-fa3719492931),volume_type_id=61d8b57f-90ce-4194-b01d-fa3719492931)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:58.823551 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e44817-ff3d-4f08-b70c-a21df3d35f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:58.828359 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e44817-ff3d-4f08-b70c-a21df3d35f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:58.841732 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c580214c-b259-48e9-a219-6362479685d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:58.847861 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c580214c-b259-48e9-a219-6362479685d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd64149e-7b71-45a0-8326-050dd4f70397', 'volume_name': 'volume-cd64149e-7b71-45a0-8326-050dd4f70397', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:58.871401 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7d3a01-b489-419a-8764-f13ef91de819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:58.876243 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7d3a01-b489-419a-8764-f13ef91de819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:58.884498 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5663bf68-27c7-4758-85fe-51b4e313feb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:58.892085 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Volume cd64149e-7b71-45a0-8326-050dd4f70397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd64149e-7b71-45a0-8326-050dd4f70397', 'volume_size': 1}
Jul 16 21:32:58.893835 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] creating volume 'volume-cd64149e-7b71-45a0-8326-050dd4f70397' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:32:58.896231 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:32:59.804049 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] extra_specs: {} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:32:59.805265 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] extra_specs: {} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:32:59.812193 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5663bf68-27c7-4758-85fe-51b4e313feb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd64149e-7b71-45a0-8326-050dd4f70397', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:59.817422 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b757f129-66a8-4092-8837-29a334a0101e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:32:59.874672 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Volume volume-cd64149e-7b71-45a0-8326-050dd4f70397 (cd64149e-7b71-45a0-8326-050dd4f70397): created successfully
Jul 16 21:32:59.885718 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b757f129-66a8-4092-8837-29a334a0101e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:32:59.887773 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Flow 'volume_create_manager' (589544d4-db18-45c3-a869-698a6f4929fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:33:00.217389 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-547f3102-e732-4db2-856c-606a577b0cdd tempest-GroupSnapshotsTest-2121718510 None] Created volume successfully.
Jul 16 21:33:00.287908 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=65,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=6 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:33:01.775499 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:33:01.816483 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Flow 'volume_create_manager' (2331bd64-9346-400d-bbe3-30bd256d8e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:33:01.826018 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf87e27-daab-4890-9a51-c71832859d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:01.852756 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf87e27-daab-4890-9a51-c71832859d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1762300096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f5d0d878-e06e-4eed-9e2f-3ac78b444fa2,host='ncdv-master-1@ceph#ceph',id=6b25dd2e-e97b-4973-b213-44d3de82b771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d6ad3663924aa3a52b865623907f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:33:02Z,use_quota=True,user_id='4757098bb5a64b1990b95f97e1ab9493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61d8b57f-90ce-4194-b01d-fa3719492931),volume_type_id=61d8b57f-90ce-4194-b01d-fa3719492931)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:33:01.858941 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d71f9fb-6396-4a00-a3c1-e05a2b542567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:01.866191 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d71f9fb-6396-4a00-a3c1-e05a2b542567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:33:01.874665 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5eba8c-78d2-4006-ba18-4a30f62d6f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:01.881949 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5eba8c-78d2-4006-ba18-4a30f62d6f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b25dd2e-e97b-4973-b213-44d3de82b771', 'volume_name': 'volume-6b25dd2e-e97b-4973-b213-44d3de82b771', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:33:01.893785 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8781075-a069-4815-9d82-80b5b9c5b941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:01.898583 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8781075-a069-4815-9d82-80b5b9c5b941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:33:01.909595 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874cbd21-8a09-416d-9416-1ff2f78bea8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:01.913250 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Volume 6b25dd2e-e97b-4973-b213-44d3de82b771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b25dd2e-e97b-4973-b213-44d3de82b771', 'volume_size': 1}
Jul 16 21:33:01.913872 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] creating volume 'volume-6b25dd2e-e97b-4973-b213-44d3de82b771' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:33:01.916177 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:02.874902 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] extra_specs: {} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:33:02.874902 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] extra_specs: {} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:33:02.877171 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874cbd21-8a09-416d-9416-1ff2f78bea8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b25dd2e-e97b-4973-b213-44d3de82b771', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:33:02.885888 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc1c7460-0169-4f54-9665-7bf0476c27d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:03.006404 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Volume volume-6b25dd2e-e97b-4973-b213-44d3de82b771 (6b25dd2e-e97b-4973-b213-44d3de82b771): created successfully
Jul 16 21:33:03.012224 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc1c7460-0169-4f54-9665-7bf0476c27d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:33:03.020164 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Flow 'volume_create_manager' (2331bd64-9346-400d-bbe3-30bd256d8e60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:33:03.153929 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-76ccde45-b52a-413a-b840-715ab9fb1b4a tempest-GroupSnapshotsTest-2121718510 None] Created volume successfully.
Jul 16 21:33:04.266763 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-c7c8971a-3527-4fcd-8bfa-c121406f80da tempest-GroupSnapshotsTest-2121718510 None] Update group completed successfully.
Jul 16 21:33:05.646041 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-049cd5bf-a3af-47c7-a934-5f682b48b021 tempest-GroupSnapshotsTest-2121718510 None] Update group completed successfully.
Jul 16 21:33:06.969644 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-daaacc62-d102-4517-a7d3-7ef76537a70d tempest-GroupSnapshotsTest-2121718510 None] Update group completed successfully.
Jul 16 21:33:08.450380 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e17f8142-21a8-4885-a0e3-af66fa9a97cc tempest-GroupSnapshotsTest-2121718510 None] Update group completed successfully.
Jul 16 21:33:10.655481 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b5fbccd8-580f-4f5b-bbb6-56267a1064b3 tempest-GroupSnapshotsTest-2121718510 None] GroupSnapshot c19f7a39-d2e3-432b-8827-5ffffa663f43: creating.
Jul 16 21:33:10.792739 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-b5fbccd8-580f-4f5b-bbb6-56267a1064b3 tempest-GroupSnapshotsTest-2121718510 None] Group snapshot c19f7a39-d2e3-432b-8827-5ffffa663f43: creating. {{(pid=131857) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4081}}
Jul 16 21:33:10.842868 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b5fbccd8-580f-4f5b-bbb6-56267a1064b3 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:12.825661 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b5fbccd8-580f-4f5b-bbb6-56267a1064b3 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:16.362717 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b5fbccd8-580f-4f5b-bbb6-56267a1064b3 tempest-GroupSnapshotsTest-2121718510 None] group_snapshot c19f7a39-d2e3-432b-8827-5ffffa663f43: created successfully
Jul 16 21:33:16.982789 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-fd624507-d307-4325-9a6a-d4c311aa4ee9 tempest-GroupSnapshotsTest-2121718510 None] group_snapshot c19f7a39-d2e3-432b-8827-5ffffa663f43: deleting
Jul 16 21:33:17.041323 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fd624507-d307-4325-9a6a-d4c311aa4ee9 tempest-GroupSnapshotsTest-2121718510 None] group_snapshot c19f7a39-d2e3-432b-8827-5ffffa663f43: deleting {{(pid=131857) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4256}}
Jul 16 21:33:17.093735 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-fd624507-d307-4325-9a6a-d4c311aa4ee9 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:19.890994 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=70,cinder:UPDATE=22,cinder:INSERT=3,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:33:19.917689 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-fd624507-d307-4325-9a6a-d4c311aa4ee9 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:22.996067 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-fd624507-d307-4325-9a6a-d4c311aa4ee9 tempest-GroupSnapshotsTest-2121718510 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-614471756 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-614471756, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:33:22.999332 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-fd624507-d307-4325-9a6a-d4c311aa4ee9 tempest-GroupSnapshotsTest-2121718510 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-614471756 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-614471756, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:33:23.170278 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-fd624507-d307-4325-9a6a-d4c311aa4ee9 tempest-GroupSnapshotsTest-2121718510 None] Created reservations ['49326bc5-5ef8-4f8d-a4f5-05ed6c28c656', 'e0e0d6a9-82ac-4814-95b6-09a4f48c9181', 'a43ace01-1ea4-435c-af14-0e3de18c6bb0', '6f821579-1c83-474b-b486-d00c2f2af091'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:33:23.817443 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-fd624507-d307-4325-9a6a-d4c311aa4ee9 tempest-GroupSnapshotsTest-2121718510 None] Created reservations ['8af4b36e-e1cd-418e-b962-535218e4c662', 'd66c092a-a11f-4fbd-8577-e4892d873a60', '3105d157-e02a-413d-b1b0-ab79e15880d2', '27c85107-3f4b-404f-84fb-aee89d975d62'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:33:23.960333 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=68,cinder:UPDATE=26,cinder:INSERT=6 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:33:24.167396 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-fd624507-d307-4325-9a6a-d4c311aa4ee9 tempest-GroupSnapshotsTest-2121718510 None] group_snapshot c19f7a39-d2e3-432b-8827-5ffffa663f43: deleted successfully
Jul 16 21:33:25.726832 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cc8307d5-eb71-4d5b-9a09-338175ba3b69 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:25.942452 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cc8307d5-eb71-4d5b-9a09-338175ba3b69 tempest-GroupSnapshotsTest-2121718510 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:33:25.942891 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cc8307d5-eb71-4d5b-9a09-338175ba3b69 tempest-GroupSnapshotsTest-2121718510 None] Volume volume-6b25dd2e-e97b-4973-b213-44d3de82b771 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:33:26.055274 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cc8307d5-eb71-4d5b-9a09-338175ba3b69 tempest-GroupSnapshotsTest-2121718510 None] deleting rbd volume volume-6b25dd2e-e97b-4973-b213-44d3de82b771 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:33:26.516495 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-533078d4-40db-42a6-99c8-11dde78d7e6f req-28c00a6f-4254-457d-abbd-6723023dce1f tempest-TaggedBootDevicesTest-1806311997 None] Terminate volume connection completed successfully.
Jul 16 21:33:26.516905 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-533078d4-40db-42a6-99c8-11dde78d7e6f req-28c00a6f-4254-457d-abbd-6723023dce1f tempest-TaggedBootDevicesTest-1806311997 None] Deleting attachment 57944f4e-5a52-4339-b402-d48307b8888f. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:33:26.853057 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-533078d4-40db-42a6-99c8-11dde78d7e6f req-7f0b53be-44c0-4b47-bca9-edb7fa71545d tempest-TaggedBootDevicesTest-1806311997 None] Terminate volume connection completed successfully.
Jul 16 21:33:26.853721 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-533078d4-40db-42a6-99c8-11dde78d7e6f req-7f0b53be-44c0-4b47-bca9-edb7fa71545d tempest-TaggedBootDevicesTest-1806311997 None] Deleting attachment 26444498-4b46-4d27-ab02-230eec120645. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:33:27.207709 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-533078d4-40db-42a6-99c8-11dde78d7e6f req-39365ab1-aa54-448d-9cb0-d13efa43ddb6 tempest-TaggedBootDevicesTest-1806311997 None] Terminate volume connection completed successfully.
Jul 16 21:33:27.208221 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-533078d4-40db-42a6-99c8-11dde78d7e6f req-39365ab1-aa54-448d-9cb0-d13efa43ddb6 tempest-TaggedBootDevicesTest-1806311997 None] Deleting attachment fdd69779-04fa-4ff5-b249-c0c3cfa904e2. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:33:29.269319 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cc8307d5-eb71-4d5b-9a09-338175ba3b69 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:29.492901 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cc8307d5-eb71-4d5b-9a09-338175ba3b69 tempest-GroupSnapshotsTest-2121718510 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:33:29.492901 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cc8307d5-eb71-4d5b-9a09-338175ba3b69 tempest-GroupSnapshotsTest-2121718510 None] Volume volume-cd64149e-7b71-45a0-8326-050dd4f70397 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:33:29.698570 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cc8307d5-eb71-4d5b-9a09-338175ba3b69 tempest-GroupSnapshotsTest-2121718510 None] deleting rbd volume volume-cd64149e-7b71-45a0-8326-050dd4f70397 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:33:33.098057 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-cc8307d5-eb71-4d5b-9a09-338175ba3b69 tempest-GroupSnapshotsTest-2121718510 None] Created reservations ['82e10543-82f6-471c-80bc-82e1af8d1c4d'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:33:33.133007 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-cc8307d5-eb71-4d5b-9a09-338175ba3b69 tempest-GroupSnapshotsTest-2121718510 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-614471756 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-614471756, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:33:33.216607 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-cc8307d5-eb71-4d5b-9a09-338175ba3b69 tempest-GroupSnapshotsTest-2121718510 None] Created reservations ['7192fedc-74c6-4b09-b578-efdd0963e53b', '30fffd78-11d8-4d1e-af99-b9b4b0d2e36b', 'c5064f2a-48f0-4fe4-b9fb-6efd26139475', 'ff4cf0cd-2c02-49dc-ae6d-57e75f2a9e88'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:33:33.646549 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-cc8307d5-eb71-4d5b-9a09-338175ba3b69 tempest-GroupSnapshotsTest-2121718510 None] Created reservations ['0af324da-a795-48a2-ab4d-81b4857d78f8', '414059e6-21a2-4165-a3c8-0d7bdd2fb282', '837061cb-2d17-4888-accf-970e53d07c6c', 'fa6c7f8b-9eb0-470d-ae24-2255bdb13637'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:33:34.200456 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cc8307d5-eb71-4d5b-9a09-338175ba3b69 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:34.260355 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cc8307d5-eb71-4d5b-9a09-338175ba3b69 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:34.334130 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-cc8307d5-eb71-4d5b-9a09-338175ba3b69 tempest-GroupSnapshotsTest-2121718510 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:33:34.338682 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-cc8307d5-eb71-4d5b-9a09-338175ba3b69 tempest-GroupSnapshotsTest-2121718510 None] Delete group completed successfully.
Jul 16 21:33:36.054953 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-7d0d893c-c299-4473-adcd-62e4242fb059 tempest-GroupSnapshotsTest-2121718510 None] Group tempest-GroupSnapshotsTest-Group-1979801783: creating
Jul 16 21:33:36.157015 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-7d0d893c-c299-4473-adcd-62e4242fb059 tempest-GroupSnapshotsTest-2121718510 None] Group tempest-GroupSnapshotsTest-Group-1979801783: created successfully
Jul 16 21:33:36.169075 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-7d0d893c-c299-4473-adcd-62e4242fb059 tempest-GroupSnapshotsTest-2121718510 None] Create group completed successfully.
Jul 16 21:33:36.775868 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:33:36.775868 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:36.844456 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:36.889721 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:33:38.756303 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:33:38.779517 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Flow 'volume_create_manager' (d36616ba-69a9-442b-bda8-c66eacdc0203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:33:38.782383 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6bf3f8e-d429-4079-9e41-540c77a05b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:38.807343 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6bf3f8e-d429-4079-9e41-540c77a05b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-58567161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c7351d0c-dd53-4fb3-817b-88459dc8dfe6,host='ncdv-master-1@ceph#ceph',id=669899b4-5253-4e51-a0bc-7fb69f211239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d6ad3663924aa3a52b865623907f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:33:38Z,use_quota=True,user_id='4757098bb5a64b1990b95f97e1ab9493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c2252ec-040d-4c2e-a690-f9875174fdc6),volume_type_id=0c2252ec-040d-4c2e-a690-f9875174fdc6)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:33:38.816537 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551c580a-990d-4200-a3a8-86d1626c1ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:38.820452 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551c580a-990d-4200-a3a8-86d1626c1ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:33:38.827137 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52032311-d399-4f72-8a51-09abffee0bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:38.836643 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52032311-d399-4f72-8a51-09abffee0bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '669899b4-5253-4e51-a0bc-7fb69f211239', 'volume_name': 'volume-669899b4-5253-4e51-a0bc-7fb69f211239', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:33:38.842271 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4737253-0bb1-41b7-9846-fed6435f85ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:38.847798 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4737253-0bb1-41b7-9846-fed6435f85ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:33:38.852914 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51023f82-db18-4f04-adca-ed675bfdce56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:38.855772 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Volume 669899b4-5253-4e51-a0bc-7fb69f211239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-669899b4-5253-4e51-a0bc-7fb69f211239', 'volume_size': 1}
Jul 16 21:33:38.856377 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] creating volume 'volume-669899b4-5253-4e51-a0bc-7fb69f211239' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:33:38.857340 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:39.564958 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] extra_specs: {} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:33:39.565614 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] extra_specs: {} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:33:39.569885 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51023f82-db18-4f04-adca-ed675bfdce56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-669899b4-5253-4e51-a0bc-7fb69f211239', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:33:39.574435 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01b4645-402b-456e-957f-fadf97c9e276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:39.686901 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Volume volume-669899b4-5253-4e51-a0bc-7fb69f211239 (669899b4-5253-4e51-a0bc-7fb69f211239): created successfully
Jul 16 21:33:39.692075 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01b4645-402b-456e-957f-fadf97c9e276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:33:39.698833 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Flow 'volume_create_manager' (d36616ba-69a9-442b-bda8-c66eacdc0203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:33:39.709423 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-0a9ec315-99f2-4606-a40b-db36ec8a7df6 tempest-TaggedBootDevicesTest-1806311997 None] Acquiring lock "cinder-f0883a5a-4e31-4e72-9db6-7d56ee50023e-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:33:39.724160 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-0a9ec315-99f2-4606-a40b-db36ec8a7df6 tempest-TaggedBootDevicesTest-1806311997 None] Lock "cinder-f0883a5a-4e31-4e72-9db6-7d56ee50023e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:33:39.783714 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-fb2cc955-927f-4d17-bdcc-8903d3dcd879 tempest-GroupSnapshotsTest-2121718510 None] Created volume successfully.
Jul 16 21:33:39.850402 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=64,cinder:INSERT=7,cinder:UPDATE=29 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:33:39.891188 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0a9ec315-99f2-4606-a40b-db36ec8a7df6 tempest-TaggedBootDevicesTest-1806311997 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:40.113447 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0a9ec315-99f2-4606-a40b-db36ec8a7df6 tempest-TaggedBootDevicesTest-1806311997 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:33:40.118423 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0a9ec315-99f2-4606-a40b-db36ec8a7df6 tempest-TaggedBootDevicesTest-1806311997 None] Volume volume-f0883a5a-4e31-4e72-9db6-7d56ee50023e is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:33:40.232736 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0a9ec315-99f2-4606-a40b-db36ec8a7df6 tempest-TaggedBootDevicesTest-1806311997 None] deleting rbd volume volume-f0883a5a-4e31-4e72-9db6-7d56ee50023e {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:33:41.087249 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-1ed57a23-fa7b-43d1-8bbd-924f7156e668 req-464cee60-3693-47eb-a528-d7a71525618e tempest-AttachVolumeShelveTestJSON-2044012735 None] No connector for attachment c81cb79a-538a-4330-8986-965e964f8f4e; skipping storage backend terminate_connection call. {{(pid=131857) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4913}}
Jul 16 21:33:41.090308 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-1ed57a23-fa7b-43d1-8bbd-924f7156e668 req-464cee60-3693-47eb-a528-d7a71525618e tempest-AttachVolumeShelveTestJSON-2044012735 None] Deleting attachment c81cb79a-538a-4330-8986-965e964f8f4e. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:33:41.635536 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-7cb98e0a-1e22-4966-b26c-215dbe00531e tempest-GroupSnapshotsTest-2121718510 None] GroupSnapshot c375f3ff-5b08-43f5-ac5e-0d77fb1d22d2: creating.
Jul 16 21:33:41.669576 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-7cb98e0a-1e22-4966-b26c-215dbe00531e tempest-GroupSnapshotsTest-2121718510 None] Group snapshot c375f3ff-5b08-43f5-ac5e-0d77fb1d22d2: creating. {{(pid=131857) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4081}}
Jul 16 21:33:41.695347 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-7cb98e0a-1e22-4966-b26c-215dbe00531e tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:44.196766 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=66,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:33:44.292417 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-0a9ec315-99f2-4606-a40b-db36ec8a7df6 tempest-TaggedBootDevicesTest-1806311997 None] Created reservations ['5f36b252-b27a-4ce4-8125-6bc304bf318d', 'f8c29d68-f419-4ebd-905a-8e5f12ad2135', '6d3dfbef-392f-44ec-b57a-7d45f6955a1b', '7fc921f3-530c-4e04-a22b-94b041694614'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:33:44.687206 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0a9ec315-99f2-4606-a40b-db36ec8a7df6 tempest-TaggedBootDevicesTest-1806311997 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:44.735098 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0a9ec315-99f2-4606-a40b-db36ec8a7df6 tempest-TaggedBootDevicesTest-1806311997 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:44.808427 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-0a9ec315-99f2-4606-a40b-db36ec8a7df6 tempest-TaggedBootDevicesTest-1806311997 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:33:44.834572 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-0a9ec315-99f2-4606-a40b-db36ec8a7df6 tempest-TaggedBootDevicesTest-1806311997 None] Deleted volume successfully.
Jul 16 21:33:44.953472 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-0a9ec315-99f2-4606-a40b-db36ec8a7df6 tempest-TaggedBootDevicesTest-1806311997 None] Lock "cinder-f0883a5a-4e31-4e72-9db6-7d56ee50023e-delete_volume" released by "delete_volume" :: held 5.226s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:33:45.195377 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-7cb98e0a-1e22-4966-b26c-215dbe00531e tempest-GroupSnapshotsTest-2121718510 None] group_snapshot c375f3ff-5b08-43f5-ac5e-0d77fb1d22d2: created successfully
Jul 16 21:33:45.401832 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-c991f64d-ceaf-4931-9987-36417ad97b1d tempest-TaggedBootDevicesTest-1806311997 None] Acquiring lock "cinder-83999d90-80b2-4c0c-8aff-bec74809b4d9-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:33:45.443994 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-c991f64d-ceaf-4931-9987-36417ad97b1d tempest-TaggedBootDevicesTest-1806311997 None] Lock "cinder-83999d90-80b2-4c0c-8aff-bec74809b4d9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:33:45.599663 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c991f64d-ceaf-4931-9987-36417ad97b1d tempest-TaggedBootDevicesTest-1806311997 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:45.886523 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c991f64d-ceaf-4931-9987-36417ad97b1d tempest-TaggedBootDevicesTest-1806311997 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:33:45.886523 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c991f64d-ceaf-4931-9987-36417ad97b1d tempest-TaggedBootDevicesTest-1806311997 None] Volume volume-83999d90-80b2-4c0c-8aff-bec74809b4d9 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:33:46.029216 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c991f64d-ceaf-4931-9987-36417ad97b1d tempest-TaggedBootDevicesTest-1806311997 None] deleting rbd volume volume-83999d90-80b2-4c0c-8aff-bec74809b4d9 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:33:46.234023 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-1d5ab3d3-ea51-49fb-ba30-42d5ec7dd469 tempest-GroupSnapshotsTest-2121718510 None] group_snapshot c375f3ff-5b08-43f5-ac5e-0d77fb1d22d2: deleting
Jul 16 21:33:46.281512 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1d5ab3d3-ea51-49fb-ba30-42d5ec7dd469 tempest-GroupSnapshotsTest-2121718510 None] group_snapshot c375f3ff-5b08-43f5-ac5e-0d77fb1d22d2: deleting {{(pid=131857) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4256}}
Jul 16 21:33:46.336288 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1d5ab3d3-ea51-49fb-ba30-42d5ec7dd469 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:50.031915 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-1d5ab3d3-ea51-49fb-ba30-42d5ec7dd469 tempest-GroupSnapshotsTest-2121718510 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1131837018 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1131837018, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:33:50.032895 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-1d5ab3d3-ea51-49fb-ba30-42d5ec7dd469 tempest-GroupSnapshotsTest-2121718510 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1131837018 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1131837018, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:33:50.173030 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-1d5ab3d3-ea51-49fb-ba30-42d5ec7dd469 tempest-GroupSnapshotsTest-2121718510 None] Created reservations ['1cc35766-0dbd-4258-911d-2e6c8ccc4d19', '750a363d-92e4-422d-8d56-bd18af465395', 'bdb7ca85-8cbf-4f5e-93d1-636f4a272f0e', 'e1ba42d1-d4ea-4d59-91ec-12ab176c5d93'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:33:50.566719 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-1d5ab3d3-ea51-49fb-ba30-42d5ec7dd469 tempest-GroupSnapshotsTest-2121718510 None] group_snapshot c375f3ff-5b08-43f5-ac5e-0d77fb1d22d2: deleted successfully
Jul 16 21:33:50.766602 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-c991f64d-ceaf-4931-9987-36417ad97b1d tempest-TaggedBootDevicesTest-1806311997 None] Created reservations ['54ebc940-fee5-40c5-b85b-fc3ebcf1eb58', 'fbae94a2-5297-48e6-9daf-439ba882c157', '5f854f17-60c5-45f4-b9c5-229c108c7a4e', 'ffcfc39a-9ace-4e65-b023-a0fd5715069c'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:33:50.918007 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=62,cinder:INSERT=6,cinder:UPDATE=31,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:33:50.988571 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c991f64d-ceaf-4931-9987-36417ad97b1d tempest-TaggedBootDevicesTest-1806311997 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:51.091601 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c991f64d-ceaf-4931-9987-36417ad97b1d tempest-TaggedBootDevicesTest-1806311997 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:51.197158 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-c991f64d-ceaf-4931-9987-36417ad97b1d tempest-TaggedBootDevicesTest-1806311997 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:33:51.216467 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-4a3aa7a0-bf7c-4276-a72b-604a9bf027df tempest-TaggedBootDevicesTest-1806311997 None] Acquiring lock "cinder-6c632192-292e-476a-92f7-a3a26a1725e6-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:33:51.216467 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-c991f64d-ceaf-4931-9987-36417ad97b1d tempest-TaggedBootDevicesTest-1806311997 None] Deleted volume successfully.
Jul 16 21:33:51.243977 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-4a3aa7a0-bf7c-4276-a72b-604a9bf027df tempest-TaggedBootDevicesTest-1806311997 None] Lock "cinder-6c632192-292e-476a-92f7-a3a26a1725e6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:33:51.304676 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-c991f64d-ceaf-4931-9987-36417ad97b1d tempest-TaggedBootDevicesTest-1806311997 None] Lock "cinder-83999d90-80b2-4c0c-8aff-bec74809b4d9-delete_volume" released by "delete_volume" :: held 5.857s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:33:51.437850 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4a3aa7a0-bf7c-4276-a72b-604a9bf027df tempest-TaggedBootDevicesTest-1806311997 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:52.312061 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4a3aa7a0-bf7c-4276-a72b-604a9bf027df tempest-TaggedBootDevicesTest-1806311997 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:33:52.403625 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4a3aa7a0-bf7c-4276-a72b-604a9bf027df tempest-TaggedBootDevicesTest-1806311997 None] deleting rbd volume volume-6c632192-292e-476a-92f7-a3a26a1725e6 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:33:52.500947 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-27cb2d3c-a548-4a83-b214-8c0ddfc600c6 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:52.834522 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-27cb2d3c-a548-4a83-b214-8c0ddfc600c6 tempest-GroupSnapshotsTest-2121718510 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:33:52.837980 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-27cb2d3c-a548-4a83-b214-8c0ddfc600c6 tempest-GroupSnapshotsTest-2121718510 None] Volume volume-669899b4-5253-4e51-a0bc-7fb69f211239 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:33:53.020846 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-27cb2d3c-a548-4a83-b214-8c0ddfc600c6 tempest-GroupSnapshotsTest-2121718510 None] deleting rbd volume volume-669899b4-5253-4e51-a0bc-7fb69f211239 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:33:57.617190 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:33:57.710793 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Flow 'volume_create_manager' (57f25df1-46a9-44b4-9859-9908db96716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:33:57.718581 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b6e556-10e0-4c0e-a569-8b91d99f530b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:57.754512 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b6e556-10e0-4c0e-a569-8b91d99f530b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-651335654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=75978d6a-3102-4e0e-bde6-0442de5a8d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2248fa190342f0bfe9211cae1e403b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:33:57Z,use_quota=True,user_id='22e264440fff43cdb7be6702839af37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:33:57.772605 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1958f2a8-8ce0-400b-89cd-ae8c483c3f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:57.777280 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1958f2a8-8ce0-400b-89cd-ae8c483c3f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:33:57.792516 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d762f0e4-5d50-4c6a-b0ab-e3f8d56d5caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:57.797226 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d762f0e4-5d50-4c6a-b0ab-e3f8d56d5caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75978d6a-3102-4e0e-bde6-0442de5a8d0a', 'volume_name': 'volume-75978d6a-3102-4e0e-bde6-0442de5a8d0a', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:33:57.803827 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35989113-bb74-446e-a7c4-6161bc444df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:57.822368 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35989113-bb74-446e-a7c4-6161bc444df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:33:57.828117 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bad006d-4c9d-497e-b227-7426f5162653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:57.829500 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Volume 75978d6a-3102-4e0e-bde6-0442de5a8d0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75978d6a-3102-4e0e-bde6-0442de5a8d0a', 'volume_size': 1}
Jul 16 21:33:57.830075 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] creating volume 'volume-75978d6a-3102-4e0e-bde6-0442de5a8d0a' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:33:57.831086 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:33:58.423701 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-27cb2d3c-a548-4a83-b214-8c0ddfc600c6 tempest-GroupSnapshotsTest-2121718510 None] Created reservations ['06840bad-6e00-401a-9664-50ed545044f9'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:33:58.454758 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-27cb2d3c-a548-4a83-b214-8c0ddfc600c6 tempest-GroupSnapshotsTest-2121718510 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1131837018 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1131837018, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:33:58.713030 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-27cb2d3c-a548-4a83-b214-8c0ddfc600c6 tempest-GroupSnapshotsTest-2121718510 None] Created reservations ['e6a2b163-8e3f-492c-bcf4-c98b6a4afb95', '566d781c-7fab-4064-9f96-e3e1b1438e46', '731db3ba-3b3e-4bcf-8b8a-13a1cbca0644', '669a4904-ecb7-4364-9a83-08e11284c9e6'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:33:58.813303 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:33:58.813750 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:33:58.818762 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bad006d-4c9d-497e-b227-7426f5162653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75978d6a-3102-4e0e-bde6-0442de5a8d0a', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:33:58.824672 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39717f5d-ba81-4e8c-9a43-fc51c61f02a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:33:58.903416 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4a3aa7a0-bf7c-4276-a72b-604a9bf027df tempest-TaggedBootDevicesTest-1806311997 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:33:59.010723 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4a3aa7a0-bf7c-4276-a72b-604a9bf027df tempest-TaggedBootDevicesTest-1806311997 None] deleting parent snapshot volume-6c632192-292e-476a-92f7-a3a26a1725e6.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:34:00.781687 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Volume volume-75978d6a-3102-4e0e-bde6-0442de5a8d0a (75978d6a-3102-4e0e-bde6-0442de5a8d0a): created successfully
Jul 16 21:34:00.786713 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39717f5d-ba81-4e8c-9a43-fc51c61f02a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:00.795190 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Flow 'volume_create_manager' (57f25df1-46a9-44b4-9859-9908db96716e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:34:00.915999 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-805d8cb3-45e6-4843-b1e0-efc12ee35921 tempest-ServersNegativeTestJSON-1102403437 None] Created volume successfully.
Jul 16 21:34:00.975663 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-27cb2d3c-a548-4a83-b214-8c0ddfc600c6 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:01.058653 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-27cb2d3c-a548-4a83-b214-8c0ddfc600c6 tempest-GroupSnapshotsTest-2121718510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:01.176745 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-27cb2d3c-a548-4a83-b214-8c0ddfc600c6 tempest-GroupSnapshotsTest-2121718510 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:34:01.182680 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-4a3aa7a0-bf7c-4276-a72b-604a9bf027df tempest-TaggedBootDevicesTest-1806311997 None] Created reservations ['31a2889f-8ff3-4e75-9c5f-45dc4cabc6ef', '973edd45-727e-409d-822b-ab9ce146d576', 'a42c7b64-0b52-4a71-9829-6a5c8c8edb18', 'aca7926e-e1ad-4be1-832c-5820ea98972f'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:34:01.188212 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-27cb2d3c-a548-4a83-b214-8c0ddfc600c6 tempest-GroupSnapshotsTest-2121718510 None] Delete group completed successfully.
Jul 16 21:34:01.474088 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:34:01.507557 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Flow 'volume_create_manager' (9a00e6bb-e5ad-427b-ba19-860766e28200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:34:01.519162 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aeca0ce-0e66-4239-b10a-34bfc2f7cf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:01.527437 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4a3aa7a0-bf7c-4276-a72b-604a9bf027df tempest-TaggedBootDevicesTest-1806311997 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:01.575687 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4a3aa7a0-bf7c-4276-a72b-604a9bf027df tempest-TaggedBootDevicesTest-1806311997 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:01.616482 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-4a3aa7a0-bf7c-4276-a72b-604a9bf027df tempest-TaggedBootDevicesTest-1806311997 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:34:01.642989 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aeca0ce-0e66-4239-b10a-34bfc2f7cf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-385338181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6067192a-2bc9-4dce-ac75-d0ecdcbbbd48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2248fa190342f0bfe9211cae1e403b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:34:01Z,use_quota=True,user_id='22e264440fff43cdb7be6702839af37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:01.650683 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21cb748b-0128-4d59-96e2-fdd1d61dd50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:01.653816 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21cb748b-0128-4d59-96e2-fdd1d61dd50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:01.661364 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9630e893-ee11-44a8-b7de-d73a20f04bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:01.664328 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9630e893-ee11-44a8-b7de-d73a20f04bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6067192a-2bc9-4dce-ac75-d0ecdcbbbd48', 'volume_name': 'volume-6067192a-2bc9-4dce-ac75-d0ecdcbbbd48', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:01.669311 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8dbd19-f3e4-46e0-bdbc-61ced9fafdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:01.673386 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8dbd19-f3e4-46e0-bdbc-61ced9fafdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:01.680092 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b796173-a4dc-4d3e-ad7c-c4c230f793ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:01.680960 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Volume 6067192a-2bc9-4dce-ac75-d0ecdcbbbd48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6067192a-2bc9-4dce-ac75-d0ecdcbbbd48', 'volume_size': 1}
Jul 16 21:34:01.681429 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] creating volume 'volume-6067192a-2bc9-4dce-ac75-d0ecdcbbbd48' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:34:01.682266 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:01.727311 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-4a3aa7a0-bf7c-4276-a72b-604a9bf027df tempest-TaggedBootDevicesTest-1806311997 None] Deleted volume successfully.
Jul 16 21:34:01.808591 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-4a3aa7a0-bf7c-4276-a72b-604a9bf027df tempest-TaggedBootDevicesTest-1806311997 None] Lock "cinder-6c632192-292e-476a-92f7-a3a26a1725e6-delete_volume" released by "delete_volume" :: held 10.569s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:34:02.166300 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:34:02.166938 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:34:02.173289 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b796173-a4dc-4d3e-ad7c-c4c230f793ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6067192a-2bc9-4dce-ac75-d0ecdcbbbd48', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:02.182907 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46dba12-d435-4af3-bfd4-f66db2be6cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:02.188575 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=30,cinder:SELECT=61,cinder:INSERT=8,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:34:02.292869 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Volume volume-6067192a-2bc9-4dce-ac75-d0ecdcbbbd48 (6067192a-2bc9-4dce-ac75-d0ecdcbbbd48): created successfully
Jul 16 21:34:02.295865 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46dba12-d435-4af3-bfd4-f66db2be6cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:02.307811 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Flow 'volume_create_manager' (9a00e6bb-e5ad-427b-ba19-860766e28200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:34:02.429085 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d608da04-c568-4b6a-bec1-7851f79bfbc8 tempest-ServersNegativeTestJSON-1102403437 None] Created volume successfully.
Jul 16 21:34:10.799758 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:34:10.824548 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Flow 'volume_create_manager' (5a6f2fc5-3ca2-43f5-98ae-03812ce419b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:34:10.833227 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1911f03c-9e5b-4d4b-8e16-eb1105b3dbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:10.867433 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1911f03c-9e5b-4d4b-8e16-eb1105b3dbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1153703895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5983464d-0767-4597-897b-2b6d4bfe82c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b06d64221ed42c5ae21cdae5223f4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:34:10Z,use_quota=True,user_id='6533ec85d2fc48d9925a88e3bbeed380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:10.874414 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45c4c41-29c9-44c8-b22e-c8ab62545f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:10.896360 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45c4c41-29c9-44c8-b22e-c8ab62545f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:10.902367 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc868a94-7db3-4945-9f4f-4f5fd11ff630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:10.906920 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc868a94-7db3-4945-9f4f-4f5fd11ff630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5983464d-0767-4597-897b-2b6d4bfe82c0', 'volume_name': 'volume-5983464d-0767-4597-897b-2b6d4bfe82c0', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:10.914193 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd960e50-e6d7-47df-81cf-de063066ab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:10.923637 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd960e50-e6d7-47df-81cf-de063066ab58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:10.932033 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6362f0c5-3ab0-43e2-82f2-fcb7096446ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:10.934868 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Volume 5983464d-0767-4597-897b-2b6d4bfe82c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5983464d-0767-4597-897b-2b6d4bfe82c0', 'volume_size': 1}
Jul 16 21:34:10.935292 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] creating volume 'volume-5983464d-0767-4597-897b-2b6d4bfe82c0' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:34:10.936011 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:11.556094 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:34:11.556468 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:34:11.560305 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6362f0c5-3ab0-43e2-82f2-fcb7096446ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5983464d-0767-4597-897b-2b6d4bfe82c0', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:11.567299 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f1d234-537b-41e8-92f8-718663b23fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:11.664552 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Volume volume-5983464d-0767-4597-897b-2b6d4bfe82c0 (5983464d-0767-4597-897b-2b6d4bfe82c0): created successfully
Jul 16 21:34:11.668410 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f1d234-537b-41e8-92f8-718663b23fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:11.673811 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Flow 'volume_create_manager' (5a6f2fc5-3ca2-43f5-98ae-03812ce419b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:34:11.749558 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f55655b0-49a6-4c5f-af73-d6191dbc0d0c tempest-SnapshotsActionsTest-1719623046 None] Created volume successfully.
Jul 16 21:34:13.175557 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3bc86117-1c53-4c77-8077-1401eba8e594 tempest-SnapshotsActionsTest-1719623046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:14.926709 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-3bc86117-1c53-4c77-8077-1401eba8e594 tempest-SnapshotsActionsTest-1719623046 None] Create snapshot completed successfully
Jul 16 21:34:16.467996 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2c032767-e957-49c8-9ebe-bd6ab3833efe tempest-SnapshotsActionsTest-1719623046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:18.761266 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-2c032767-e957-49c8-9ebe-bd6ab3833efe tempest-SnapshotsActionsTest-1719623046 None] Create snapshot completed successfully
Jul 16 21:34:19.653015 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-bc77db75-50be-4b27-b659-f0939aa7c8cc tempest-SnapshotsActionsTest-416846580 None] Acquiring lock "cinder-e4de0ff2-d584-439a-9d86-6e52fcfd4432-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:34:19.666800 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-bc77db75-50be-4b27-b659-f0939aa7c8cc tempest-SnapshotsActionsTest-416846580 None] Lock "cinder-e4de0ff2-d584-439a-9d86-6e52fcfd4432-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:34:19.670661 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bc77db75-50be-4b27-b659-f0939aa7c8cc tempest-SnapshotsActionsTest-416846580 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:22.422068 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=57,cinder:UPDATE=34,cinder:INSERT=4,cinder:DELETE=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:34:22.590123 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-bc77db75-50be-4b27-b659-f0939aa7c8cc tempest-SnapshotsActionsTest-416846580 None] Created reservations ['3d855c4e-9d0a-4ad9-b0b8-96d0e2691aec', '24ef5b9c-6e48-4407-9848-96a5c0068c54', '25c06132-71ea-40cb-bec2-a4ea7bd1a0f3', '886deb39-7d60-4cad-a292-aaf95eaf11ca'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:34:22.784708 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-bc77db75-50be-4b27-b659-f0939aa7c8cc tempest-SnapshotsActionsTest-416846580 None] Delete snapshot completed successfully.
Jul 16 21:34:22.795107 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-bc77db75-50be-4b27-b659-f0939aa7c8cc tempest-SnapshotsActionsTest-416846580 None] Lock "cinder-e4de0ff2-d584-439a-9d86-6e52fcfd4432-delete_snapshot" released by "delete_snapshot" :: held 3.126s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:34:23.714418 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-23dbd13f-8ad5-418d-8750-945480422273 tempest-SnapshotsActionsTest-1719623046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:26.148842 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-23dbd13f-8ad5-418d-8750-945480422273 tempest-SnapshotsActionsTest-1719623046 None] Create snapshot completed successfully
Jul 16 21:34:26.872152 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-16362634-96b8-4e93-b509-f3c8c13b3e13 tempest-SnapshotsActionsTest-416846580 None] Acquiring lock "cinder-8fe14035-842a-49ca-a0af-b3bce10ee2c8-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:34:26.894409 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-16362634-96b8-4e93-b509-f3c8c13b3e13 tempest-SnapshotsActionsTest-416846580 None] Lock "cinder-8fe14035-842a-49ca-a0af-b3bce10ee2c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:34:26.896540 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-16362634-96b8-4e93-b509-f3c8c13b3e13 tempest-SnapshotsActionsTest-416846580 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:30.076103 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-16362634-96b8-4e93-b509-f3c8c13b3e13 tempest-SnapshotsActionsTest-416846580 None] Created reservations ['5176575d-c463-4711-aaec-0de0a823b3a2', '3a1547ba-52b0-4713-b0f0-029dd186ad83', 'a57a65bf-2a7b-4073-afef-c15d0f8de5c5', '8e30b2ac-8475-4600-9a1f-3337e988522b'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:34:30.287360 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-16362634-96b8-4e93-b509-f3c8c13b3e13 tempest-SnapshotsActionsTest-416846580 None] Delete snapshot completed successfully.
Jul 16 21:34:30.287360 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-16362634-96b8-4e93-b509-f3c8c13b3e13 tempest-SnapshotsActionsTest-416846580 None] Lock "cinder-8fe14035-842a-49ca-a0af-b3bce10ee2c8-delete_snapshot" released by "delete_snapshot" :: held 3.393s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:34:32.176909 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e21550b1-3375-4dee-a1b8-3bc666674700 tempest-SnapshotsActionsTest-1719623046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:33.910584 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e21550b1-3375-4dee-a1b8-3bc666674700 tempest-SnapshotsActionsTest-1719623046 None] Create snapshot completed successfully
Jul 16 21:34:34.459948 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e200f7f0-f567-4ebb-aa77-592320177d01 tempest-SnapshotsActionsTest-416846580 None] Acquiring lock "cinder-273aea7e-3bb3-48df-b12e-469be9f4bd82-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:34:34.482070 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e200f7f0-f567-4ebb-aa77-592320177d01 tempest-SnapshotsActionsTest-416846580 None] Lock "cinder-273aea7e-3bb3-48df-b12e-469be9f4bd82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:34:34.486982 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e200f7f0-f567-4ebb-aa77-592320177d01 tempest-SnapshotsActionsTest-416846580 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:36.597923 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=56,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=8 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:34:36.719682 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-e200f7f0-f567-4ebb-aa77-592320177d01 tempest-SnapshotsActionsTest-416846580 None] Created reservations ['400dddad-161d-475a-8538-a5940ce79307', 'a8fd33ca-209e-463d-ad0f-4c85b2d66867', 'd5a5c6ca-e6ff-457b-a8f8-9c860d8bdf26', '7d45f555-c365-4f28-a15b-ce927911837a'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:34:36.776879 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:34:36.778403 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:36.812443 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:36.843754 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:34:36.956999 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e200f7f0-f567-4ebb-aa77-592320177d01 tempest-SnapshotsActionsTest-416846580 None] Delete snapshot completed successfully.
Jul 16 21:34:36.965953 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e200f7f0-f567-4ebb-aa77-592320177d01 tempest-SnapshotsActionsTest-416846580 None] Lock "cinder-273aea7e-3bb3-48df-b12e-469be9f4bd82-delete_snapshot" released by "delete_snapshot" :: held 2.480s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:34:38.554236 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4b7f67b4-580f-483e-8a77-4c14c6f408fe tempest-SnapshotsActionsTest-1719623046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:40.565786 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-4b7f67b4-580f-483e-8a77-4c14c6f408fe tempest-SnapshotsActionsTest-1719623046 None] Create snapshot completed successfully
Jul 16 21:34:41.889446 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-babfd3ba-5bd3-4220-8fc2-c5b488f2f89a tempest-SnapshotsActionsTest-416846580 None] Acquiring lock "cinder-23a39c58-60c8-4e1f-8ffa-352b4747a01c-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:34:41.910234 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-babfd3ba-5bd3-4220-8fc2-c5b488f2f89a tempest-SnapshotsActionsTest-416846580 None] Lock "cinder-23a39c58-60c8-4e1f-8ffa-352b4747a01c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:34:41.918350 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-babfd3ba-5bd3-4220-8fc2-c5b488f2f89a tempest-SnapshotsActionsTest-416846580 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:43.580521 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:34:43.601169 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Flow 'volume_create_manager' (2fbe3157-a269-44ea-910b-dfec14dd0bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:34:43.609873 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd6cb09-d459-445f-81fb-0c54bb2d7a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:43.629614 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd6cb09-d459-445f-81fb-0c54bb2d7a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-595720770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=048fbb68-c884-46b4-aa78-58477a185196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd0ce287cb44cd59045868ce688909a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:34:43Z,use_quota=True,user_id='726b46c54e9541fbb7825607bac3abe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:43.636161 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc83a6a-64d9-4614-8e92-3e5b4e95aa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:43.640836 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc83a6a-64d9-4614-8e92-3e5b4e95aa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:43.646802 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c97d5f-e39b-444f-961b-7367b740dc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:43.777673 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c97d5f-e39b-444f-961b-7367b740dc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '048fbb68-c884-46b4-aa78-58477a185196', 'volume_name': 'volume-048fbb68-c884-46b4-aa78-58477a185196', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f55ca60>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:43.781783 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0594c25-c37e-41b4-95d2-0284759d46fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:43.786586 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0594c25-c37e-41b4-95d2-0284759d46fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:43.792399 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f14629-b78d-41fc-b3f4-e2e5cc2193e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:43.794014 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Volume 048fbb68-c884-46b4-aa78-58477a185196: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-048fbb68-c884-46b4-aa78-58477a185196', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f55ca60>}
Jul 16 21:34:43.794779 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Cloning 048fbb68-c884-46b4-aa78-58477a185196 from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9  at location (None, None). {{(pid=131857) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Jul 16 21:34:43.797160 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Acquiring lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" by "_prepare_image_cache_entry" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:34:43.819550 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" acquired by "_prepare_image_cache_entry" :: waited 0.021s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:34:43.909041 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 34, 43, 833519)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:34:43.909932 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:34:43.910492 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Found cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Jul 16 21:34:43.915808 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" released by "_prepare_image_cache_entry" :: held 0.098s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:34:43.916965 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Attempting to retrieve cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Jul 16 21:34:43.930678 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 34, 43, 922103)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:34:43.931420 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:34:43.931955 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Creating from source image-volume b59b3901-b32a-4d92-81b0-6b99e88e4517 {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Jul 16 21:34:43.961887 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:44.320714 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] creating snapshot='volume-048fbb68-c884-46b4-aa78-58477a185196.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:34:46.446299 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] cloning 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517@volume-048fbb68-c884-46b4-aa78-58477a185196.clone_snap' to 'volume-048fbb68-c884-46b4-aa78-58477a185196' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:34:47.070915 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-babfd3ba-5bd3-4220-8fc2-c5b488f2f89a tempest-SnapshotsActionsTest-416846580 None] Created reservations ['081fb1c6-ee67-477d-8259-66e8cada69a7', '81e55fcb-3921-4f14-acae-f0fe9c681b7a', 'dd467fe6-9aa3-4171-8741-2bbf309bd489', '4dd68dc8-abeb-4ce0-a7b8-f5a8f9d9900b'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:34:47.313820 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-babfd3ba-5bd3-4220-8fc2-c5b488f2f89a tempest-SnapshotsActionsTest-416846580 None] Delete snapshot completed successfully.
Jul 16 21:34:47.328797 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-babfd3ba-5bd3-4220-8fc2-c5b488f2f89a tempest-SnapshotsActionsTest-416846580 None] Lock "cinder-23a39c58-60c8-4e1f-8ffa-352b4747a01c-delete_snapshot" released by "delete_snapshot" :: held 5.409s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:34:47.518650 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945.deleted is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:34:47.523307 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:34:47.523691 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:34:47.926089 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:34:47.926089 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Marking volume 048fbb68-c884-46b4-aa78-58477a185196 as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:34:48.013656 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Copying metadata from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 to 048fbb68-c884-46b4-aa78-58477a185196. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Jul 16 21:34:48.015219 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Creating volume glance metadata for volume 048fbb68-c884-46b4-aa78-58477a185196 backed by image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131857) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Jul 16 21:34:48.129575 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=61,cinder:UPDATE=25,cinder:INSERT=13,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:34:48.237936 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f14629-b78d-41fc-b3f4-e2e5cc2193e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-048fbb68-c884-46b4-aa78-58477a185196', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f55ca60>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:48.244090 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced1efc6-8fd7-494e-b0a9-ef9be75cf06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:48.376671 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Volume volume-048fbb68-c884-46b4-aa78-58477a185196 (048fbb68-c884-46b4-aa78-58477a185196): created successfully
Jul 16 21:34:48.382188 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced1efc6-8fd7-494e-b0a9-ef9be75cf06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:48.396016 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Flow 'volume_create_manager' (2fbe3157-a269-44ea-910b-dfec14dd0bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:34:48.551239 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-80bbd257-26bd-4acb-a954-2592b4a3e5d8 tempest-TaggedBootDevicesTest_v242-896656767 None] Created volume successfully.
Jul 16 21:34:48.961502 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f62f07c4-0f7d-42f4-816d-a3ddc549a674 tempest-SnapshotsActionsTest-1719623046 None] Acquiring lock "cinder-d10ac746-b670-4090-8b66-1b0023ef1f87-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:34:48.982658 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f62f07c4-0f7d-42f4-816d-a3ddc549a674 tempest-SnapshotsActionsTest-1719623046 None] Lock "cinder-d10ac746-b670-4090-8b66-1b0023ef1f87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:34:48.993610 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f62f07c4-0f7d-42f4-816d-a3ddc549a674 tempest-SnapshotsActionsTest-1719623046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:50.130169 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:34:50.182677 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Flow 'volume_create_manager' (cacd048c-7d6d-4fa4-a779-f99e4a37e300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:34:50.197296 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a00c6e-0e11-4f3c-a1cd-dc8770830b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:50.261063 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a00c6e-0e11-4f3c-a1cd-dc8770830b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1622842721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c4869fe9-11ee-40cf-8401-386b1a3bec57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd0ce287cb44cd59045868ce688909a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:34:50Z,use_quota=True,user_id='726b46c54e9541fbb7825607bac3abe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:50.280811 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e8e93f-4549-4949-90c3-b4a9c13e2ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:50.290627 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e8e93f-4549-4949-90c3-b4a9c13e2ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:50.318287 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b7c1d57-ca60-4ae8-b536-efade0ae278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:50.330035 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b7c1d57-ca60-4ae8-b536-efade0ae278b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4869fe9-11ee-40cf-8401-386b1a3bec57', 'volume_name': 'volume-c4869fe9-11ee-40cf-8401-386b1a3bec57', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:50.346981 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91323234-c559-4788-961d-14f3ad641543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:50.366041 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91323234-c559-4788-961d-14f3ad641543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:50.378487 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6945e5ab-eeac-410d-a285-a2ad5473edba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:50.390130 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Volume c4869fe9-11ee-40cf-8401-386b1a3bec57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4869fe9-11ee-40cf-8401-386b1a3bec57', 'volume_size': 1}
Jul 16 21:34:50.391828 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] creating volume 'volume-c4869fe9-11ee-40cf-8401-386b1a3bec57' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:34:50.394861 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:51.155207 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:34:51.155784 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:34:51.165573 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6945e5ab-eeac-410d-a285-a2ad5473edba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4869fe9-11ee-40cf-8401-386b1a3bec57', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:51.176657 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4483cef8-86b7-4107-8410-2775bd6089d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:51.285532 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Volume volume-c4869fe9-11ee-40cf-8401-386b1a3bec57 (c4869fe9-11ee-40cf-8401-386b1a3bec57): created successfully
Jul 16 21:34:51.289818 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4483cef8-86b7-4107-8410-2775bd6089d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:51.299679 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Flow 'volume_create_manager' (cacd048c-7d6d-4fa4-a779-f99e4a37e300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:34:51.410867 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d98c53a8-bbb2-42a9-a35f-2738275c38f2 tempest-TaggedBootDevicesTest_v242-896656767 None] Created volume successfully.
Jul 16 21:34:51.636017 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-f62f07c4-0f7d-42f4-816d-a3ddc549a674 tempest-SnapshotsActionsTest-1719623046 None] Created reservations ['b6a73625-c5c4-49f8-91b1-5e5325463ffb', '1f83ff35-a48f-40cb-8bc9-92e3f12f6e5d', '857f90a2-0d3f-4520-89c8-68f6a25012d3', '9d71ffa0-bbbe-4ce6-b61d-2197736f7649'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:34:51.927833 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f62f07c4-0f7d-42f4-816d-a3ddc549a674 tempest-SnapshotsActionsTest-1719623046 None] Delete snapshot completed successfully.
Jul 16 21:34:51.938339 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f62f07c4-0f7d-42f4-816d-a3ddc549a674 tempest-SnapshotsActionsTest-1719623046 None] Lock "cinder-d10ac746-b670-4090-8b66-1b0023ef1f87-delete_snapshot" released by "delete_snapshot" :: held 2.951s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:34:52.518076 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-2f666a3e-11a5-4417-9cd3-dabecca6edce tempest-SnapshotsActionsTest-1719623046 None] Acquiring lock "cinder-5983464d-0767-4597-897b-2b6d4bfe82c0-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:34:52.529584 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-2f666a3e-11a5-4417-9cd3-dabecca6edce tempest-SnapshotsActionsTest-1719623046 None] Lock "cinder-5983464d-0767-4597-897b-2b6d4bfe82c0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:34:52.674766 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2f666a3e-11a5-4417-9cd3-dabecca6edce tempest-SnapshotsActionsTest-1719623046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:52.850864 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2f666a3e-11a5-4417-9cd3-dabecca6edce tempest-SnapshotsActionsTest-1719623046 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:34:52.851406 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2f666a3e-11a5-4417-9cd3-dabecca6edce tempest-SnapshotsActionsTest-1719623046 None] Volume volume-5983464d-0767-4597-897b-2b6d4bfe82c0 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:34:53.029635 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2f666a3e-11a5-4417-9cd3-dabecca6edce tempest-SnapshotsActionsTest-1719623046 None] deleting rbd volume volume-5983464d-0767-4597-897b-2b6d4bfe82c0 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:34:53.292369 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:34:53.333274 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Flow 'volume_create_manager' (f8c9bf3b-8627-4d0c-b185-8cd2593cdf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:34:53.358415 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0c40aa-437f-41a6-83df-14f27724adac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:53.393191 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0c40aa-437f-41a6-83df-14f27724adac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-631718490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=35056502-3c4b-4440-9da4-2bbf9347f08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd0ce287cb44cd59045868ce688909a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:34:53Z,use_quota=True,user_id='726b46c54e9541fbb7825607bac3abe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:53.406227 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590dd90b-ae42-48ee-955c-6fa7d067b0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:53.423459 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590dd90b-ae42-48ee-955c-6fa7d067b0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:53.435941 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f60b0e0-28b0-4783-8a1c-caee990ea31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:53.446473 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f60b0e0-28b0-4783-8a1c-caee990ea31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35056502-3c4b-4440-9da4-2bbf9347f08f', 'volume_name': 'volume-35056502-3c4b-4440-9da4-2bbf9347f08f', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:53.459246 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ba5ef5-ce2e-47a4-9f48-4f0805da8e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:53.465878 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ba5ef5-ce2e-47a4-9f48-4f0805da8e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:53.476169 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261f400d-91bb-4032-baa9-09e61f603670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:53.477235 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Volume 35056502-3c4b-4440-9da4-2bbf9347f08f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35056502-3c4b-4440-9da4-2bbf9347f08f', 'volume_size': 1}
Jul 16 21:34:53.477630 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] creating volume 'volume-35056502-3c4b-4440-9da4-2bbf9347f08f' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:34:53.478410 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:54.531742 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9fbad4af-e3b5-4f5e-9aa6-14beb096bc6e tempest-AttachVolumeShelveTestJSON-2044012735 None] Acquiring lock "cinder-3ac2d5bc-2859-4330-aaae-14914ce01b8a-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:34:54.541707 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9fbad4af-e3b5-4f5e-9aa6-14beb096bc6e tempest-AttachVolumeShelveTestJSON-2044012735 None] Lock "cinder-3ac2d5bc-2859-4330-aaae-14914ce01b8a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:34:54.649538 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:34:54.649969 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:34:54.653852 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261f400d-91bb-4032-baa9-09e61f603670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35056502-3c4b-4440-9da4-2bbf9347f08f', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:54.659738 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f10a19-9849-4c72-a82c-dc9952ae68eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:34:54.745615 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9fbad4af-e3b5-4f5e-9aa6-14beb096bc6e tempest-AttachVolumeShelveTestJSON-2044012735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:54.962031 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9fbad4af-e3b5-4f5e-9aa6-14beb096bc6e tempest-AttachVolumeShelveTestJSON-2044012735 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:34:54.967599 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9fbad4af-e3b5-4f5e-9aa6-14beb096bc6e tempest-AttachVolumeShelveTestJSON-2044012735 None] Volume volume-3ac2d5bc-2859-4330-aaae-14914ce01b8a is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:34:55.126480 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9fbad4af-e3b5-4f5e-9aa6-14beb096bc6e tempest-AttachVolumeShelveTestJSON-2044012735 None] deleting rbd volume volume-3ac2d5bc-2859-4330-aaae-14914ce01b8a {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:34:55.129565 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Volume volume-35056502-3c4b-4440-9da4-2bbf9347f08f (35056502-3c4b-4440-9da4-2bbf9347f08f): created successfully
Jul 16 21:34:55.142606 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f10a19-9849-4c72-a82c-dc9952ae68eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:34:55.164723 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Flow 'volume_create_manager' (f8c9bf3b-8627-4d0c-b185-8cd2593cdf0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:34:55.275864 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-99cd32fd-5310-4044-90a5-307550d0500c tempest-TaggedBootDevicesTest_v242-896656767 None] Created volume successfully.
Jul 16 21:34:58.463595 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=63,cinder:UPDATE=26,cinder:INSERT=9,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:34:58.642342 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-2f666a3e-11a5-4417-9cd3-dabecca6edce tempest-SnapshotsActionsTest-1719623046 None] Created reservations ['c9d190e0-1490-4a6e-8586-4172bf63bfb3', 'e70e8e11-d0cd-4aab-9f25-6cfaf2980a33', 'c92f07b3-564d-4697-9150-7a3a54cd51d9', '87b49955-896d-4987-aa7a-8fdf03595be9'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:34:58.972503 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2f666a3e-11a5-4417-9cd3-dabecca6edce tempest-SnapshotsActionsTest-1719623046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:59.363849 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2f666a3e-11a5-4417-9cd3-dabecca6edce tempest-SnapshotsActionsTest-1719623046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:34:59.428329 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-2f666a3e-11a5-4417-9cd3-dabecca6edce tempest-SnapshotsActionsTest-1719623046 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:34:59.433138 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-2f666a3e-11a5-4417-9cd3-dabecca6edce tempest-SnapshotsActionsTest-1719623046 None] Deleted volume successfully.
Jul 16 21:34:59.601703 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-2f666a3e-11a5-4417-9cd3-dabecca6edce tempest-SnapshotsActionsTest-1719623046 None] Lock "cinder-5983464d-0767-4597-897b-2b6d4bfe82c0-delete_volume" released by "delete_volume" :: held 7.072s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:35:00.625136 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-9fbad4af-e3b5-4f5e-9aa6-14beb096bc6e tempest-AttachVolumeShelveTestJSON-2044012735 None] Created reservations ['d5e0c91e-ad0e-4ad1-ba83-e81d5da6842a', '4c289abd-c5da-4a20-9ef0-e4137b98771b', 'fe619041-3b75-4fe0-9861-8fc6af0a4169', '4bed1bdc-1479-45cc-b409-0ed85f666cc9'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:35:00.880838 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=54,cinder:UPDATE=34,cinder:INSERT=10,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:35:00.996922 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9fbad4af-e3b5-4f5e-9aa6-14beb096bc6e tempest-AttachVolumeShelveTestJSON-2044012735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:01.113298 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9fbad4af-e3b5-4f5e-9aa6-14beb096bc6e tempest-AttachVolumeShelveTestJSON-2044012735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:01.180118 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-9fbad4af-e3b5-4f5e-9aa6-14beb096bc6e tempest-AttachVolumeShelveTestJSON-2044012735 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:35:01.184753 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-9fbad4af-e3b5-4f5e-9aa6-14beb096bc6e tempest-AttachVolumeShelveTestJSON-2044012735 None] Deleted volume successfully.
Jul 16 21:35:01.295249 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9fbad4af-e3b5-4f5e-9aa6-14beb096bc6e tempest-AttachVolumeShelveTestJSON-2044012735 None] Lock "cinder-3ac2d5bc-2859-4330-aaae-14914ce01b8a-delete_volume" released by "delete_volume" :: held 6.753s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:35:01.809899 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-45c819c4-8908-4d48-a132-4d6eb01917ef tempest-AttachVolumeShelveTestJSON-2044012735 None] Acquiring lock "cinder-18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:35:01.845025 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-45c819c4-8908-4d48-a132-4d6eb01917ef tempest-AttachVolumeShelveTestJSON-2044012735 None] Lock "cinder-18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:35:02.154035 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-45c819c4-8908-4d48-a132-4d6eb01917ef tempest-AttachVolumeShelveTestJSON-2044012735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:02.411314 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-45c819c4-8908-4d48-a132-4d6eb01917ef tempest-AttachVolumeShelveTestJSON-2044012735 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:35:02.412652 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-45c819c4-8908-4d48-a132-4d6eb01917ef tempest-AttachVolumeShelveTestJSON-2044012735 None] Volume volume-18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:35:02.511986 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-45c819c4-8908-4d48-a132-4d6eb01917ef tempest-AttachVolumeShelveTestJSON-2044012735 None] deleting rbd volume volume-18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:35:05.243709 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-fbc13e51-5e9b-414a-a570-00ef870ff915 tempest-GroupsV314Test-378147201 None] Group tempest-GroupsV314Test-Group-1568653180: creating
Jul 16 21:35:05.388544 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-fbc13e51-5e9b-414a-a570-00ef870ff915 tempest-GroupsV314Test-378147201 None] Group tempest-GroupsV314Test-Group-1568653180: created successfully
Jul 16 21:35:05.447313 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-fbc13e51-5e9b-414a-a570-00ef870ff915 tempest-GroupsV314Test-378147201 None] Create group completed successfully.
Jul 16 21:35:05.614781 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-45c819c4-8908-4d48-a132-4d6eb01917ef tempest-AttachVolumeShelveTestJSON-2044012735 None] Created reservations ['48ade0d0-30f4-42f2-bdbb-9267b81e1501', 'b734f728-24c0-4069-9fe4-ee6951f8d102', '40a01425-de41-4591-a4b1-c7745629f21b', '20bdf3c7-efba-4f67-b8ef-6c3b06f47480'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:35:05.877214 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-45c819c4-8908-4d48-a132-4d6eb01917ef tempest-AttachVolumeShelveTestJSON-2044012735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:05.966833 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-45c819c4-8908-4d48-a132-4d6eb01917ef tempest-AttachVolumeShelveTestJSON-2044012735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:06.035616 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-45c819c4-8908-4d48-a132-4d6eb01917ef tempest-AttachVolumeShelveTestJSON-2044012735 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:35:06.061719 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-45c819c4-8908-4d48-a132-4d6eb01917ef tempest-AttachVolumeShelveTestJSON-2044012735 None] Deleted volume successfully.
Jul 16 21:35:06.168129 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-45c819c4-8908-4d48-a132-4d6eb01917ef tempest-AttachVolumeShelveTestJSON-2044012735 None] Lock "cinder-18e9c5fe-8f27-4cbf-bbe8-0e1f902e6813-delete_volume" released by "delete_volume" :: held 4.323s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:35:07.972076 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:35:08.004883 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Flow 'volume_create_manager' (cea63112-51d7-46c0-a0d8-f8da42024a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:35:08.014331 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db05ce94-9940-4eb4-8623-68afb3e1ef73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:08.048775 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db05ce94-9940-4eb4-8623-68afb3e1ef73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1467021954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=934b3960-c845-423b-bd1d-ddd9e388c2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a73639b88974ba3ae4e94485cc0beac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:35:08Z,use_quota=True,user_id='45b11273f4554199a70c95c3ef68ebb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:08.062304 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3fd67f-de64-4b29-8c66-242b45aadba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:08.070930 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3fd67f-de64-4b29-8c66-242b45aadba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:08.115552 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e1935f-d073-4826-b677-c18e64a6755d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:08.119108 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e1935f-d073-4826-b677-c18e64a6755d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '934b3960-c845-423b-bd1d-ddd9e388c2cb', 'volume_name': 'volume-934b3960-c845-423b-bd1d-ddd9e388c2cb', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:08.130016 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7471ec2c-2119-43a8-8ecd-48401c14753c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:08.136850 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7471ec2c-2119-43a8-8ecd-48401c14753c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:08.146981 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a2a4d6-c08c-4f9a-a830-a3b549cd5be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:08.148544 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Volume 934b3960-c845-423b-bd1d-ddd9e388c2cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-934b3960-c845-423b-bd1d-ddd9e388c2cb', 'volume_size': 1}
Jul 16 21:35:08.149138 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] creating volume 'volume-934b3960-c845-423b-bd1d-ddd9e388c2cb' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:35:08.150100 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:08.340363 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:35:08.340363 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Flow 'volume_create_manager' (466681c6-bf2f-41c9-98d3-54e3c035c4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:35:08.340363 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f56677-c8e3-4196-a310-6b1404e171b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:08.341177 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f56677-c8e3-4196-a310-6b1404e171b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-1378288694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b5638fab-0b65-45fe-8add-6d17744930bb,host='ncdv-master-1@ceph#ceph',id=bdca60da-cc9d-4fc3-b520-86d87dd7099f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc32d1f1c894e2f8207fbebe1d6c71c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:35:08Z,use_quota=True,user_id='da9c5eb730564c47965b28ffddfeeacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4283a873-9b8a-4795-92c6-e445bb39a0cd),volume_type_id=4283a873-9b8a-4795-92c6-e445bb39a0cd)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:08.341396 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183f7245-bb91-4627-b824-50dbf9608dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:08.342149 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183f7245-bb91-4627-b824-50dbf9608dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:08.357036 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9afcb3-10dd-4373-81a7-88c44b10044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:08.367797 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9afcb3-10dd-4373-81a7-88c44b10044b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdca60da-cc9d-4fc3-b520-86d87dd7099f', 'volume_name': 'volume-bdca60da-cc9d-4fc3-b520-86d87dd7099f', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:08.372808 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eddae83-8790-4fc2-86d1-27f6f03f0b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:08.378924 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eddae83-8790-4fc2-86d1-27f6f03f0b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:08.384667 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7411f832-ed8f-4801-9f5c-b43384dc1b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:08.385822 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Volume bdca60da-cc9d-4fc3-b520-86d87dd7099f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdca60da-cc9d-4fc3-b520-86d87dd7099f', 'volume_size': 1}
Jul 16 21:35:08.386219 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] creating volume 'volume-bdca60da-cc9d-4fc3-b520-86d87dd7099f' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:35:08.386874 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:09.275864 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:35:09.277047 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:35:09.286103 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a2a4d6-c08c-4f9a-a830-a3b549cd5be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-934b3960-c845-423b-bd1d-ddd9e388c2cb', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:09.295097 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (239d2cf4-da72-425b-9b93-4c6163245fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:09.465877 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] extra_specs: {} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:35:09.466597 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] extra_specs: {} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:35:09.470807 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7411f832-ed8f-4801-9f5c-b43384dc1b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdca60da-cc9d-4fc3-b520-86d87dd7099f', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:09.479999 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c959e599-46ae-4d43-8352-b115241e439e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:09.497661 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Volume volume-934b3960-c845-423b-bd1d-ddd9e388c2cb (934b3960-c845-423b-bd1d-ddd9e388c2cb): created successfully
Jul 16 21:35:09.509914 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (239d2cf4-da72-425b-9b93-4c6163245fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:09.529159 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Flow 'volume_create_manager' (cea63112-51d7-46c0-a0d8-f8da42024a8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:35:09.646579 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Volume volume-bdca60da-cc9d-4fc3-b520-86d87dd7099f (bdca60da-cc9d-4fc3-b520-86d87dd7099f): created successfully
Jul 16 21:35:09.651759 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c959e599-46ae-4d43-8352-b115241e439e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:09.662204 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Flow 'volume_create_manager' (466681c6-bf2f-41c9-98d3-54e3c035c4c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:35:09.689001 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-28908527-d5e7-42c8-b99c-ab85f347878d tempest-SnapshotMetadataTestJSON-996778452 None] Created volume successfully.
Jul 16 21:35:09.744763 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-cd031109-7568-41da-9823-bcb49e73c21d tempest-GroupsV314Test-378147201 None] Created volume successfully.
Jul 16 21:35:10.668695 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ea2c4197-9a35-4e72-bc7c-12887259623d tempest-SnapshotMetadataTestJSON-996778452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:11.303451 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0c4c0c54-d073-480d-ac1d-7bc4dd88258d tempest-GroupsV314Test-378147201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:11.479895 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0c4c0c54-d073-480d-ac1d-7bc4dd88258d tempest-GroupsV314Test-378147201 None] creating snapshot='volume-0b668913-9951-4c0a-b4fc-0ed12125b3ef.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:35:13.780190 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0c4c0c54-d073-480d-ac1d-7bc4dd88258d tempest-GroupsV314Test-378147201 None] cloning 'volume-bdca60da-cc9d-4fc3-b520-86d87dd7099f@volume-0b668913-9951-4c0a-b4fc-0ed12125b3ef.clone_snap' to 'volume-0b668913-9951-4c0a-b4fc-0ed12125b3ef' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:35:14.826073 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-ea2c4197-9a35-4e72-bc7c-12887259623d tempest-SnapshotMetadataTestJSON-996778452 None] Create snapshot completed successfully
Jul 16 21:35:15.255031 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0c4c0c54-d073-480d-ac1d-7bc4dd88258d tempest-GroupsV314Test-378147201 None] Volume volume-bdca60da-cc9d-4fc3-b520-86d87dd7099f is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:35:15.260799 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0c4c0c54-d073-480d-ac1d-7bc4dd88258d tempest-GroupsV314Test-378147201 None] extra_specs: {} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:35:15.261294 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0c4c0c54-d073-480d-ac1d-7bc4dd88258d tempest-GroupsV314Test-378147201 None] extra_specs: {} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:35:15.498541 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0c4c0c54-d073-480d-ac1d-7bc4dd88258d tempest-GroupsV314Test-378147201 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:35:15.947944 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-0c4c0c54-d073-480d-ac1d-7bc4dd88258d tempest-GroupsV314Test-378147201 None] Create group from source-group-b5638fab-0b65-45fe-8add-6d17744930bb completed successfully.
Jul 16 21:35:16.789436 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-91afbe76-0d8a-4e80-a946-6dc39b40af45 tempest-GroupsV314Test-378147201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:16.974236 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-91afbe76-0d8a-4e80-a946-6dc39b40af45 tempest-GroupsV314Test-378147201 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:35:17.048182 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-91afbe76-0d8a-4e80-a946-6dc39b40af45 tempest-GroupsV314Test-378147201 None] deleting rbd volume volume-0b668913-9951-4c0a-b4fc-0ed12125b3ef {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:35:17.935591 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-4056a966-f641-4844-99da-e07925340b2f tempest-SnapshotMetadataTestJSON-996778452 None] Acquiring lock "cinder-e6a3c7ca-9931-46b9-9132-1119315c3437-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:35:17.974190 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-4056a966-f641-4844-99da-e07925340b2f tempest-SnapshotMetadataTestJSON-996778452 None] Lock "cinder-e6a3c7ca-9931-46b9-9132-1119315c3437-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:35:17.975728 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4056a966-f641-4844-99da-e07925340b2f tempest-SnapshotMetadataTestJSON-996778452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:20.844667 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-91afbe76-0d8a-4e80-a946-6dc39b40af45 tempest-GroupsV314Test-378147201 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:35:21.012971 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-91afbe76-0d8a-4e80-a946-6dc39b40af45 tempest-GroupsV314Test-378147201 None] Volume volume-bdca60da-cc9d-4fc3-b520-86d87dd7099f is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:35:21.013514 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-91afbe76-0d8a-4e80-a946-6dc39b40af45 tempest-GroupsV314Test-378147201 None] deleting parent snapshot volume-0b668913-9951-4c0a-b4fc-0ed12125b3ef.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:35:23.076880 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 req-dd1ec735-7f24-4f0e-af0f-565e25bb7e25 tempest-TaggedBootDevicesTest_v242-896656767 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:35:23.448930 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-91afbe76-0d8a-4e80-a946-6dc39b40af45 tempest-GroupsV314Test-378147201 None] Created reservations ['0cddbd57-42bd-479f-b022-963e03dca8e0'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:35:23.536045 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-91afbe76-0d8a-4e80-a946-6dc39b40af45 tempest-GroupsV314Test-378147201 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1671146237 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1671146237, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:35:23.537613 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-91afbe76-0d8a-4e80-a946-6dc39b40af45 tempest-GroupsV314Test-378147201 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1671146237 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1671146237, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:35:23.682923 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-4056a966-f641-4844-99da-e07925340b2f tempest-SnapshotMetadataTestJSON-996778452 None] Created reservations ['46d62707-5fe0-46f2-826c-5967884fae66', 'ef692a06-ebf4-49b3-bac5-144c670106fc', '21079ffa-5f0d-462c-a344-4edf6a28c757', 'ab6f223d-a1ef-43b9-86d1-c98137c749cf'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:35:23.689909 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-91afbe76-0d8a-4e80-a946-6dc39b40af45 tempest-GroupsV314Test-378147201 None] Created reservations ['f56c8924-8ef0-47b5-b432-2d51ce735110', 'b2f77581-3f7a-4328-a5f2-d77a3ef231d2', '3581775d-596c-464e-9e78-0a013a80d000', 'da843082-1fc9-49ad-a5a7-19c24ba0ca6b'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:35:23.693437 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=26,cinder:SELECT=65,cinder:DELETE=3,cinder:INSERT=6 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:35:23.781327 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=67,cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:35:23.917511 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-4056a966-f641-4844-99da-e07925340b2f tempest-SnapshotMetadataTestJSON-996778452 None] Delete snapshot completed successfully.
Jul 16 21:35:23.942752 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-4056a966-f641-4844-99da-e07925340b2f tempest-SnapshotMetadataTestJSON-996778452 None] Lock "cinder-e6a3c7ca-9931-46b9-9132-1119315c3437-delete_snapshot" released by "delete_snapshot" :: held 5.969s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:35:24.137807 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-91afbe76-0d8a-4e80-a946-6dc39b40af45 tempest-GroupsV314Test-378147201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:24.236002 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-91afbe76-0d8a-4e80-a946-6dc39b40af45 tempest-GroupsV314Test-378147201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:24.377697 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-91afbe76-0d8a-4e80-a946-6dc39b40af45 tempest-GroupsV314Test-378147201 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:35:24.383773 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-91afbe76-0d8a-4e80-a946-6dc39b40af45 tempest-GroupsV314Test-378147201 None] Delete group completed successfully.
Jul 16 21:35:24.570607 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 req-dd1ec735-7f24-4f0e-af0f-565e25bb7e25 tempest-TaggedBootDevicesTest_v242-896656767 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.494s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:35:24.572001 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 req-dd1ec735-7f24-4f0e-af0f-565e25bb7e25 tempest-TaggedBootDevicesTest_v242-896656767 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-048fbb68-c884-46b4-aa78-58477a185196', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '048fbb68-c884-46b4-aa78-58477a185196', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:35:24.674721 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-af7e319e-9bd2-4848-9fb1-a772efa2340b tempest-SnapshotMetadataTestJSON-996778452 None] Acquiring lock "cinder-934b3960-c845-423b-bd1d-ddd9e388c2cb-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:35:24.692830 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-af7e319e-9bd2-4848-9fb1-a772efa2340b tempest-SnapshotMetadataTestJSON-996778452 None] Lock "cinder-934b3960-c845-423b-bd1d-ddd9e388c2cb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:35:24.707710 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 req-dd1ec735-7f24-4f0e-af0f-565e25bb7e25 tempest-TaggedBootDevicesTest_v242-896656767 None] Connection info returned from driver {'name': 'volumes/volume-048fbb68-c884-46b4-aa78-58477a185196', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '048fbb68-c884-46b4-aa78-58477a185196', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1fcc5b3b-78e8-423c-83fb-c7909a8cb869'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:35:25.017494 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-af7e319e-9bd2-4848-9fb1-a772efa2340b tempest-SnapshotMetadataTestJSON-996778452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:25.236164 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-af7e319e-9bd2-4848-9fb1-a772efa2340b tempest-SnapshotMetadataTestJSON-996778452 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:35:25.236164 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-af7e319e-9bd2-4848-9fb1-a772efa2340b tempest-SnapshotMetadataTestJSON-996778452 None] Volume volume-934b3960-c845-423b-bd1d-ddd9e388c2cb is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:35:25.318462 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-af7e319e-9bd2-4848-9fb1-a772efa2340b tempest-SnapshotMetadataTestJSON-996778452 None] deleting rbd volume volume-934b3960-c845-423b-bd1d-ddd9e388c2cb {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:35:25.372650 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 req-dd1ec735-7f24-4f0e-af0f-565e25bb7e25 tempest-TaggedBootDevicesTest_v242-896656767 None] attachment_update completed successfully.
Jul 16 21:35:25.739980 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4748d9ca-fe34-40f1-994d-c0b6656ad632 tempest-GroupsV314Test-378147201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:26.030764 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4748d9ca-fe34-40f1-994d-c0b6656ad632 tempest-GroupsV314Test-378147201 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:35:26.031539 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4748d9ca-fe34-40f1-994d-c0b6656ad632 tempest-GroupsV314Test-378147201 None] Volume volume-bdca60da-cc9d-4fc3-b520-86d87dd7099f is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:35:26.174399 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4748d9ca-fe34-40f1-994d-c0b6656ad632 tempest-GroupsV314Test-378147201 None] deleting rbd volume volume-bdca60da-cc9d-4fc3-b520-86d87dd7099f {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:35:26.488950 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 req-0749e583-b9e4-457e-b909-a767810d7314 tempest-TaggedBootDevicesTest_v242-896656767 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:35:27.662749 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 req-0749e583-b9e4-457e-b909-a767810d7314 tempest-TaggedBootDevicesTest_v242-896656767 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.173s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:35:27.664216 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 req-0749e583-b9e4-457e-b909-a767810d7314 tempest-TaggedBootDevicesTest_v242-896656767 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c4869fe9-11ee-40cf-8401-386b1a3bec57', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'c4869fe9-11ee-40cf-8401-386b1a3bec57', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:35:27.786707 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 req-0749e583-b9e4-457e-b909-a767810d7314 tempest-TaggedBootDevicesTest_v242-896656767 None] Connection info returned from driver {'name': 'volumes/volume-c4869fe9-11ee-40cf-8401-386b1a3bec57', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c4869fe9-11ee-40cf-8401-386b1a3bec57', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '09ae566c-5d70-49de-a3f7-90442985a5b5'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:35:28.038841 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 req-0749e583-b9e4-457e-b909-a767810d7314 tempest-TaggedBootDevicesTest_v242-896656767 None] attachment_update completed successfully.
Jul 16 21:35:29.166738 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 req-05fb476f-fa36-4b90-ba2b-244501cd3d4e tempest-TaggedBootDevicesTest_v242-896656767 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:35:30.661752 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-af7e319e-9bd2-4848-9fb1-a772efa2340b tempest-SnapshotMetadataTestJSON-996778452 None] Created reservations ['1327acc7-2c63-4146-98dc-42dad0d4d16b', '7ecc80dc-1d7a-46d4-8eb4-aafe0604fbf0', 'c4f14123-77f7-475f-b96a-10fd6d715aab', 'a323954a-854e-430f-b895-ce6503fde437'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:35:30.922119 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-af7e319e-9bd2-4848-9fb1-a772efa2340b tempest-SnapshotMetadataTestJSON-996778452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:31.057763 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-af7e319e-9bd2-4848-9fb1-a772efa2340b tempest-SnapshotMetadataTestJSON-996778452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:31.149167 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-af7e319e-9bd2-4848-9fb1-a772efa2340b tempest-SnapshotMetadataTestJSON-996778452 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:35:31.175468 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 req-05fb476f-fa36-4b90-ba2b-244501cd3d4e tempest-TaggedBootDevicesTest_v242-896656767 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.009s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:35:31.178781 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-af7e319e-9bd2-4848-9fb1-a772efa2340b tempest-SnapshotMetadataTestJSON-996778452 None] Deleted volume successfully.
Jul 16 21:35:31.186016 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 req-05fb476f-fa36-4b90-ba2b-244501cd3d4e tempest-TaggedBootDevicesTest_v242-896656767 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-35056502-3c4b-4440-9da4-2bbf9347f08f', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '35056502-3c4b-4440-9da4-2bbf9347f08f', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:35:31.301991 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-af7e319e-9bd2-4848-9fb1-a772efa2340b tempest-SnapshotMetadataTestJSON-996778452 None] Lock "cinder-934b3960-c845-423b-bd1d-ddd9e388c2cb-delete_volume" released by "delete_volume" :: held 6.606s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:35:31.681080 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 req-05fb476f-fa36-4b90-ba2b-244501cd3d4e tempest-TaggedBootDevicesTest_v242-896656767 None] Connection info returned from driver {'name': 'volumes/volume-35056502-3c4b-4440-9da4-2bbf9347f08f', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '35056502-3c4b-4440-9da4-2bbf9347f08f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a1f1d8c1-96b1-4770-849b-068587bd42ca'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:35:31.686718 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=33,cinder:SELECT=65,cinder:INSERT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:35:31.948761 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-4748d9ca-fe34-40f1-994d-c0b6656ad632 tempest-GroupsV314Test-378147201 None] Created reservations ['17989256-dfc8-426d-82ca-6aad352312b3'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:35:32.050974 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-3f8186c1-4e47-40a9-b381-bcf8677fdba9 req-05fb476f-fa36-4b90-ba2b-244501cd3d4e tempest-TaggedBootDevicesTest_v242-896656767 None] attachment_update completed successfully.
Jul 16 21:35:32.194466 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-4748d9ca-fe34-40f1-994d-c0b6656ad632 tempest-GroupsV314Test-378147201 None] Created reservations ['eba2243b-58d5-4e64-b035-b1dd289b1c7d', '407ffb25-20d8-4964-8242-6fa070ee8c9f', 'b42d13b3-a6bf-476b-88fe-c97eacb5d7e1', 'f6540cdc-e2c9-4533-98dd-195f25d5e1fc'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:35:32.477039 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=62,cinder:INSERT=7,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:35:32.740566 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4748d9ca-fe34-40f1-994d-c0b6656ad632 tempest-GroupsV314Test-378147201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:32.859968 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4748d9ca-fe34-40f1-994d-c0b6656ad632 tempest-GroupsV314Test-378147201 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:32.953776 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-4748d9ca-fe34-40f1-994d-c0b6656ad632 tempest-GroupsV314Test-378147201 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:35:32.958753 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-4748d9ca-fe34-40f1-994d-c0b6656ad632 tempest-GroupsV314Test-378147201 None] Delete group completed successfully.
Jul 16 21:35:36.779751 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:35:36.782981 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:36.886537 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:36.960910 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:35:38.834070 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:35:38.868096 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Flow 'volume_create_manager' (1ec4e4fe-5b9b-4f21-913c-3d20d4779eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:35:38.873085 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66bb7de-bce2-41e5-8d6e-bf51d2dc24cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:38.893846 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66bb7de-bce2-41e5-8d6e-bf51d2dc24cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-879259343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8ec2dd1d-aafa-42ea-8765-bd19fcc62053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd90fa9beaa1427ba08d9c19e794e4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:35:39Z,use_quota=True,user_id='90540ab472324f9988e33e4fcc4eaebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:38.905834 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfaa9931-6c13-4c20-87e9-010b793f6983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:38.905834 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfaa9931-6c13-4c20-87e9-010b793f6983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:38.909114 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96d84a3-5249-4f16-8390-30594e55a716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:38.913391 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96d84a3-5249-4f16-8390-30594e55a716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ec2dd1d-aafa-42ea-8765-bd19fcc62053', 'volume_name': 'volume-8ec2dd1d-aafa-42ea-8765-bd19fcc62053', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:38.918625 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c51680-0b1a-4d57-b474-8262a281b7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:38.922483 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c51680-0b1a-4d57-b474-8262a281b7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:38.928018 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248d83d4-9e95-4df1-b9e3-fdfb9f8e8a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:38.929112 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Volume 8ec2dd1d-aafa-42ea-8765-bd19fcc62053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ec2dd1d-aafa-42ea-8765-bd19fcc62053', 'volume_size': 1}
Jul 16 21:35:38.929508 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] creating volume 'volume-8ec2dd1d-aafa-42ea-8765-bd19fcc62053' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:35:38.930279 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:39.445132 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:35:39.445132 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:35:39.448931 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248d83d4-9e95-4df1-b9e3-fdfb9f8e8a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ec2dd1d-aafa-42ea-8765-bd19fcc62053', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:39.455238 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb0e6a6-eafe-4b31-8246-18e776aeaba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:39.555329 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Volume volume-8ec2dd1d-aafa-42ea-8765-bd19fcc62053 (8ec2dd1d-aafa-42ea-8765-bd19fcc62053): created successfully
Jul 16 21:35:39.559199 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb0e6a6-eafe-4b31-8246-18e776aeaba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:39.564829 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Flow 'volume_create_manager' (1ec4e4fe-5b9b-4f21-913c-3d20d4779eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:35:39.677989 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-01f51c48-aabe-4f75-bcc5-6f4b18cbe3f5 tempest-VolumesMetadataTest-1658622409 None] Created volume successfully.
Jul 16 21:35:42.582416 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-d3b43348-6ae9-41eb-9b5f-69f2b8e877de tempest-VolumesMetadataTest-1658622409 None] Acquiring lock "cinder-8ec2dd1d-aafa-42ea-8765-bd19fcc62053-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:35:42.591519 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-d3b43348-6ae9-41eb-9b5f-69f2b8e877de tempest-VolumesMetadataTest-1658622409 None] Lock "cinder-8ec2dd1d-aafa-42ea-8765-bd19fcc62053-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:35:42.765278 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d3b43348-6ae9-41eb-9b5f-69f2b8e877de tempest-VolumesMetadataTest-1658622409 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:42.978206 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d3b43348-6ae9-41eb-9b5f-69f2b8e877de tempest-VolumesMetadataTest-1658622409 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:35:42.978206 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d3b43348-6ae9-41eb-9b5f-69f2b8e877de tempest-VolumesMetadataTest-1658622409 None] Volume volume-8ec2dd1d-aafa-42ea-8765-bd19fcc62053 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:35:43.072979 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d3b43348-6ae9-41eb-9b5f-69f2b8e877de tempest-VolumesMetadataTest-1658622409 None] deleting rbd volume volume-8ec2dd1d-aafa-42ea-8765-bd19fcc62053 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:35:45.923456 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-d3b43348-6ae9-41eb-9b5f-69f2b8e877de tempest-VolumesMetadataTest-1658622409 None] Created reservations ['b9c35938-2a89-405b-ba76-17c8f06af4b4', '231be067-44a4-4243-b1e8-3817a0b7f4be', 'f55acf8a-9f2e-45ed-a82d-2db845bf61e8', '4244aac5-7aad-45a4-a8ba-124d27efeca2'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:35:46.204403 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d3b43348-6ae9-41eb-9b5f-69f2b8e877de tempest-VolumesMetadataTest-1658622409 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:46.275928 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d3b43348-6ae9-41eb-9b5f-69f2b8e877de tempest-VolumesMetadataTest-1658622409 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:46.336544 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-d3b43348-6ae9-41eb-9b5f-69f2b8e877de tempest-VolumesMetadataTest-1658622409 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:35:46.347168 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d3b43348-6ae9-41eb-9b5f-69f2b8e877de tempest-VolumesMetadataTest-1658622409 None] Deleted volume successfully.
Jul 16 21:35:46.446808 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-d3b43348-6ae9-41eb-9b5f-69f2b8e877de tempest-VolumesMetadataTest-1658622409 None] Lock "cinder-8ec2dd1d-aafa-42ea-8765-bd19fcc62053-delete_volume" released by "delete_volume" :: held 3.855s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:35:52.474687 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:35:52.496333 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Flow 'volume_create_manager' (7847f3ec-ea4b-4a4e-9c65-f3bced66c6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:35:52.503590 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a156ecd3-37a6-4243-afeb-ba478611dda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:52.520655 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a156ecd3-37a6-4243-afeb-ba478611dda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1659489896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7d4b816c-5436-4be5-a7dc-a2131cbe5207,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17f9e0949e6b4269843b7afbdcb192eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:35:52Z,use_quota=True,user_id='8a57d14469064f9f99a655a79f19a59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:52.526609 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25ff244-510c-4fc8-9625-ea322263af22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:52.530816 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25ff244-510c-4fc8-9625-ea322263af22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:52.536538 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea393a8-af15-4a3a-b57d-2d747b9d9f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:52.540710 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea393a8-af15-4a3a-b57d-2d747b9d9f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d4b816c-5436-4be5-a7dc-a2131cbe5207', 'volume_name': 'volume-7d4b816c-5436-4be5-a7dc-a2131cbe5207', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:52.545850 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ece4fd5-c826-493b-91e9-fd9c2b96e5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:52.550736 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ece4fd5-c826-493b-91e9-fd9c2b96e5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:52.555777 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360930ca-d0db-45d6-8a1c-9f53c2e5b07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:52.557458 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Volume 7d4b816c-5436-4be5-a7dc-a2131cbe5207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d4b816c-5436-4be5-a7dc-a2131cbe5207', 'volume_size': 1}
Jul 16 21:35:52.558929 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] creating volume 'volume-7d4b816c-5436-4be5-a7dc-a2131cbe5207' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:35:52.558929 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:53.032625 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:35:53.033002 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:35:53.037706 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360930ca-d0db-45d6-8a1c-9f53c2e5b07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d4b816c-5436-4be5-a7dc-a2131cbe5207', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:53.044159 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9535025a-0cb5-48f7-82f2-8807efc8b97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:53.111785 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Volume volume-7d4b816c-5436-4be5-a7dc-a2131cbe5207 (7d4b816c-5436-4be5-a7dc-a2131cbe5207): created successfully
Jul 16 21:35:53.118627 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9535025a-0cb5-48f7-82f2-8807efc8b97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:53.124669 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Flow 'volume_create_manager' (7847f3ec-ea4b-4a4e-9c65-f3bced66c6bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:35:53.215299 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-6a7c2318-842d-448a-8ff0-eb4e63a3dd01 tempest-VolumesListTestJSON-1072157541 None] Created volume successfully.
Jul 16 21:35:54.521610 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:35:54.556869 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Flow 'volume_create_manager' (f09d1fa6-0c43-443e-b598-5f95ddae109e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:35:54.569066 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7e5100-6a28-4d36-9d49-c755af494fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:54.595739 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7e5100-6a28-4d36-9d49-c755af494fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1119113703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b125c38c-91f5-47d1-99e0-93ebe05af4b4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17f9e0949e6b4269843b7afbdcb192eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:35:54Z,use_quota=True,user_id='8a57d14469064f9f99a655a79f19a59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:54.602871 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11b815e-aa18-4421-8e8f-9f18b919a0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:54.608984 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11b815e-aa18-4421-8e8f-9f18b919a0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:54.616812 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05987ef2-160c-4adc-b377-819e91c4c74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:54.622682 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05987ef2-160c-4adc-b377-819e91c4c74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b125c38c-91f5-47d1-99e0-93ebe05af4b4', 'volume_name': 'volume-b125c38c-91f5-47d1-99e0-93ebe05af4b4', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:54.632189 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445fca88-d929-4c3b-83a6-6427cfd98e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:54.642750 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445fca88-d929-4c3b-83a6-6427cfd98e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:54.665782 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b074b9f-be60-48b5-baf5-ac16a44f0b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:54.679543 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Volume b125c38c-91f5-47d1-99e0-93ebe05af4b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b125c38c-91f5-47d1-99e0-93ebe05af4b4', 'volume_size': 1}
Jul 16 21:35:54.680723 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] creating volume 'volume-b125c38c-91f5-47d1-99e0-93ebe05af4b4' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:35:54.682922 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:55.327804 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:35:55.328662 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:35:55.333576 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b074b9f-be60-48b5-baf5-ac16a44f0b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b125c38c-91f5-47d1-99e0-93ebe05af4b4', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:55.338925 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c9684f-48a2-45f9-ad6e-74e1adefd842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:55.427827 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Volume volume-b125c38c-91f5-47d1-99e0-93ebe05af4b4 (b125c38c-91f5-47d1-99e0-93ebe05af4b4): created successfully
Jul 16 21:35:55.433605 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c9684f-48a2-45f9-ad6e-74e1adefd842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:55.442128 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Flow 'volume_create_manager' (f09d1fa6-0c43-443e-b598-5f95ddae109e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:35:55.522203 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-1e60f4db-fcd5-4e03-8353-0c5c2daed72b tempest-VolumesListTestJSON-1072157541 None] Created volume successfully.
Jul 16 21:35:55.942573 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:35:55.969688 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Flow 'volume_create_manager' (6ff80fd1-64be-4e24-ac3a-e1d6b403e7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:35:55.994371 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda0101d-84c4-41a7-a10e-ae95cf2bac4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:56.020715 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda0101d-84c4-41a7-a10e-ae95cf2bac4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1609272312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c29f195b-a383-486b-8ce5-88e4e138e2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3cbf1e2ddad48cc9bfc38e8c93ed63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:35:56Z,use_quota=True,user_id='3c57c0a417d94a51907ac4dd4509a322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:56.036347 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a328dd-50bf-4c7f-b5d8-2de54d46cdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:56.036347 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a328dd-50bf-4c7f-b5d8-2de54d46cdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:56.036347 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d0bb7d-1641-4475-87ff-1a096ee05b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:56.039962 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d0bb7d-1641-4475-87ff-1a096ee05b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29f195b-a383-486b-8ce5-88e4e138e2b8', 'volume_name': 'volume-c29f195b-a383-486b-8ce5-88e4e138e2b8', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:56.044703 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0149b9af-4e02-40ae-b64d-6db7982f1d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:56.048605 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0149b9af-4e02-40ae-b64d-6db7982f1d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:56.053975 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e9d6df-4c5d-4fac-97f4-bc3547fc67ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:56.055106 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Volume c29f195b-a383-486b-8ce5-88e4e138e2b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29f195b-a383-486b-8ce5-88e4e138e2b8', 'volume_size': 1}
Jul 16 21:35:56.055443 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] creating volume 'volume-c29f195b-a383-486b-8ce5-88e4e138e2b8' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:35:56.056161 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:56.626995 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:35:56.647854 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Flow 'volume_create_manager' (9a60998e-d2ae-45e6-9444-31d7f3b6d296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:35:56.654617 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f37b217-2317-4814-af30-09b1193cb853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:56.671714 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f37b217-2317-4814-af30-09b1193cb853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1082221969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6331801a-9232-4447-810c-28b0c7fd9b38,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17f9e0949e6b4269843b7afbdcb192eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:35:56Z,use_quota=True,user_id='8a57d14469064f9f99a655a79f19a59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:56.679163 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc73c35-f949-4cdb-9dd6-1225f9910fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:56.683943 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc73c35-f949-4cdb-9dd6-1225f9910fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:56.689742 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c5484f-1738-48f7-8188-60889108d9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:56.695350 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c5484f-1738-48f7-8188-60889108d9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6331801a-9232-4447-810c-28b0c7fd9b38', 'volume_name': 'volume-6331801a-9232-4447-810c-28b0c7fd9b38', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:56.700190 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77d6d65-0a60-493a-a990-8504bda77a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:56.704106 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77d6d65-0a60-493a-a990-8504bda77a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:56.709068 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d0c53a-2f2b-4e8c-a4c7-428579f06612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:56.710246 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Volume 6331801a-9232-4447-810c-28b0c7fd9b38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6331801a-9232-4447-810c-28b0c7fd9b38', 'volume_size': 1}
Jul 16 21:35:56.710807 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] creating volume 'volume-6331801a-9232-4447-810c-28b0c7fd9b38' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:35:56.711483 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:56.751001 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:35:56.751627 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:35:56.756660 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e9d6df-4c5d-4fac-97f4-bc3547fc67ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29f195b-a383-486b-8ce5-88e4e138e2b8', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:56.761405 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34d3625-2604-49d0-a314-123582ec6bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:56.843232 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Volume volume-c29f195b-a383-486b-8ce5-88e4e138e2b8 (c29f195b-a383-486b-8ce5-88e4e138e2b8): created successfully
Jul 16 21:35:56.848368 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34d3625-2604-49d0-a314-123582ec6bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:56.853912 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Flow 'volume_create_manager' (6ff80fd1-64be-4e24-ac3a-e1d6b403e7b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:35:56.966432 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-62aa7c8a-c236-43fc-a832-b2b58defcb15 tempest-VolumeQuotasAdminTestJSON-1741565137 None] Created volume successfully.
Jul 16 21:35:57.138509 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:35:57.138954 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:35:57.142781 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d0c53a-2f2b-4e8c-a4c7-428579f06612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6331801a-9232-4447-810c-28b0c7fd9b38', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:57.147582 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b26db17-9c1b-4f8a-81a4-e1e275132364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:35:57.218490 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Volume volume-6331801a-9232-4447-810c-28b0c7fd9b38 (6331801a-9232-4447-810c-28b0c7fd9b38): created successfully
Jul 16 21:35:57.223059 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b26db17-9c1b-4f8a-81a4-e1e275132364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:35:57.228785 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Flow 'volume_create_manager' (9a60998e-d2ae-45e6-9444-31d7f3b6d296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:35:57.328409 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-ad484c02-5dd6-4a7e-9f01-259403002f5d tempest-VolumesListTestJSON-1072157541 None] Created volume successfully.
Jul 16 21:35:58.266413 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b4f05631-a919-4ff5-804c-b73f98f6fabb tempest-VolumeQuotasAdminTestJSON-1741565137 None] Acquiring lock "cinder-c29f195b-a383-486b-8ce5-88e4e138e2b8-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:35:58.279258 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b4f05631-a919-4ff5-804c-b73f98f6fabb tempest-VolumeQuotasAdminTestJSON-1741565137 None] Lock "cinder-c29f195b-a383-486b-8ce5-88e4e138e2b8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:35:58.400536 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4f05631-a919-4ff5-804c-b73f98f6fabb tempest-VolumeQuotasAdminTestJSON-1741565137 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:35:58.535135 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4f05631-a919-4ff5-804c-b73f98f6fabb tempest-VolumeQuotasAdminTestJSON-1741565137 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:35:58.535942 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4f05631-a919-4ff5-804c-b73f98f6fabb tempest-VolumeQuotasAdminTestJSON-1741565137 None] Volume volume-c29f195b-a383-486b-8ce5-88e4e138e2b8 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:35:58.636862 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4f05631-a919-4ff5-804c-b73f98f6fabb tempest-VolumeQuotasAdminTestJSON-1741565137 None] deleting rbd volume volume-c29f195b-a383-486b-8ce5-88e4e138e2b8 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:36:00.135395 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-81a23b85-15f8-4569-a9a3-74aaa45fc48a tempest-VolumesListTestJSON-1072157541 None] Acquiring lock "cinder-6331801a-9232-4447-810c-28b0c7fd9b38-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:36:00.159915 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-81a23b85-15f8-4569-a9a3-74aaa45fc48a tempest-VolumesListTestJSON-1072157541 None] Lock "cinder-6331801a-9232-4447-810c-28b0c7fd9b38-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:36:00.298271 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-81a23b85-15f8-4569-a9a3-74aaa45fc48a tempest-VolumesListTestJSON-1072157541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:00.619582 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-81a23b85-15f8-4569-a9a3-74aaa45fc48a tempest-VolumesListTestJSON-1072157541 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:36:00.623276 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-81a23b85-15f8-4569-a9a3-74aaa45fc48a tempest-VolumesListTestJSON-1072157541 None] Volume volume-6331801a-9232-4447-810c-28b0c7fd9b38 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:36:00.774907 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-81a23b85-15f8-4569-a9a3-74aaa45fc48a tempest-VolumesListTestJSON-1072157541 None] deleting rbd volume volume-6331801a-9232-4447-810c-28b0c7fd9b38 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:36:01.353128 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-980d8a5f-0cbd-4ef9-935c-0c972e2063db tempest-ServersNegativeTestJSON-1102403437 None] Acquiring lock "cinder-6067192a-2bc9-4dce-ac75-d0ecdcbbbd48-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:36:01.370282 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-980d8a5f-0cbd-4ef9-935c-0c972e2063db tempest-ServersNegativeTestJSON-1102403437 None] Lock "cinder-6067192a-2bc9-4dce-ac75-d0ecdcbbbd48-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:36:01.520372 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-980d8a5f-0cbd-4ef9-935c-0c972e2063db tempest-ServersNegativeTestJSON-1102403437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:01.642389 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-980d8a5f-0cbd-4ef9-935c-0c972e2063db tempest-ServersNegativeTestJSON-1102403437 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:36:01.642862 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-980d8a5f-0cbd-4ef9-935c-0c972e2063db tempest-ServersNegativeTestJSON-1102403437 None] Volume volume-6067192a-2bc9-4dce-ac75-d0ecdcbbbd48 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:36:01.837715 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-980d8a5f-0cbd-4ef9-935c-0c972e2063db tempest-ServersNegativeTestJSON-1102403437 None] deleting rbd volume volume-6067192a-2bc9-4dce-ac75-d0ecdcbbbd48 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:36:02.978062 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-b4f05631-a919-4ff5-804c-b73f98f6fabb tempest-VolumeQuotasAdminTestJSON-1741565137 None] Created reservations ['bc121fc7-0e9f-4341-8589-6c33372e80da', '4c95569d-8cdf-46a5-be4a-60d725e76902', 'a1b30035-7655-44ea-9122-c4f819edb805', 'ac903d25-3b8f-4d10-9558-f3e094bdd695'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:36:03.104785 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=64,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=6 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:36:03.181090 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4f05631-a919-4ff5-804c-b73f98f6fabb tempest-VolumeQuotasAdminTestJSON-1741565137 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:03.208119 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b4f05631-a919-4ff5-804c-b73f98f6fabb tempest-VolumeQuotasAdminTestJSON-1741565137 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:03.236696 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-b4f05631-a919-4ff5-804c-b73f98f6fabb tempest-VolumeQuotasAdminTestJSON-1741565137 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:36:03.242002 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b4f05631-a919-4ff5-804c-b73f98f6fabb tempest-VolumeQuotasAdminTestJSON-1741565137 None] Deleted volume successfully.
Jul 16 21:36:03.360957 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b4f05631-a919-4ff5-804c-b73f98f6fabb tempest-VolumeQuotasAdminTestJSON-1741565137 None] Lock "cinder-c29f195b-a383-486b-8ce5-88e4e138e2b8-delete_volume" released by "delete_volume" :: held 5.083s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:36:04.547035 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:36:04.569620 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Flow 'volume_create_manager' (e1eb39a6-ba5c-424c-922f-b1b529ad8d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:36:04.575962 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a736b7-959d-4399-8a31-ff97bad70c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:04.593177 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a736b7-959d-4399-8a31-ff97bad70c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2058543929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=832da595-24c8-48e3-9799-6294804fbab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3cbf1e2ddad48cc9bfc38e8c93ed63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:36:04Z,use_quota=True,user_id='3c57c0a417d94a51907ac4dd4509a322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:04.598657 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11b551e-ca70-4bc2-932d-2d5b8f8fb958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:04.602778 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11b551e-ca70-4bc2-932d-2d5b8f8fb958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:04.608123 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4799ef27-0c44-419a-a38a-5cd81a218938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:04.612159 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4799ef27-0c44-419a-a38a-5cd81a218938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '832da595-24c8-48e3-9799-6294804fbab5', 'volume_name': 'volume-832da595-24c8-48e3-9799-6294804fbab5', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:04.620823 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f24b378-d56a-460b-8610-839ba0a0029e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:04.620994 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f24b378-d56a-460b-8610-839ba0a0029e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:04.625688 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177a7e61-9bc8-4e8a-aa73-0694d0f50084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:04.626736 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Volume 832da595-24c8-48e3-9799-6294804fbab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-832da595-24c8-48e3-9799-6294804fbab5', 'volume_size': 1}
Jul 16 21:36:04.627164 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] creating volume 'volume-832da595-24c8-48e3-9799-6294804fbab5' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:36:04.628449 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:06.149841 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:36:06.150452 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:36:06.154104 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177a7e61-9bc8-4e8a-aa73-0694d0f50084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-832da595-24c8-48e3-9799-6294804fbab5', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:06.158753 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d02a19-40f2-49dd-af9a-a8dbd60d3154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:06.163822 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=62,cinder:UPDATE=29,cinder:INSERT=2,cinder:DELETE=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:36:06.249343 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Volume volume-832da595-24c8-48e3-9799-6294804fbab5 (832da595-24c8-48e3-9799-6294804fbab5): created successfully
Jul 16 21:36:06.260128 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d02a19-40f2-49dd-af9a-a8dbd60d3154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:06.275314 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Flow 'volume_create_manager' (e1eb39a6-ba5c-424c-922f-b1b529ad8d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:36:06.399629 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:36:06.427458 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Flow 'volume_create_manager' (d9ad3b19-89e5-4b6a-8e34-20f32727d56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:36:06.434060 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24fb0d9-f2e0-46a3-8317-966018f36028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:06.438724 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-81a23b85-15f8-4569-a9a3-74aaa45fc48a tempest-VolumesListTestJSON-1072157541 None] Created reservations ['87cc7e7d-f8c8-4803-988e-9f16bbe3c19e', 'fc931bce-479c-496b-b40c-97cdd6fe35b7', 'e2b4ded9-beae-44da-828a-7c79eaf42638', '4dd9901c-2b53-4069-a3a4-a60a7504b1ac'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:36:06.443959 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-3907f0ad-d165-403e-9067-16790490d83e tempest-VolumeQuotasAdminTestJSON-1741565137 None] Created volume successfully.
Jul 16 21:36:06.493303 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24fb0d9-f2e0-46a3-8317-966018f36028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1778895894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=116c847b-4e23-4992-ab59-ef12019a9b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bc69aef04a436498a38c4f1efaf88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:36:06Z,use_quota=True,user_id='a691f131ccef4fb4989137852816abc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:06.500107 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef75a1b-82bb-4ee1-aec1-0f9fad9253a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:06.506270 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef75a1b-82bb-4ee1-aec1-0f9fad9253a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:06.512307 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e917b490-b410-46f4-8440-da95da865731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:06.617936 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e917b490-b410-46f4-8440-da95da865731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '116c847b-4e23-4992-ab59-ef12019a9b0d', 'volume_name': 'volume-116c847b-4e23-4992-ab59-ef12019a9b0d', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95919faac0>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:06.622861 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4074cb6b-b8d0-48ab-88d8-01100b6cc363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:06.626815 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4074cb6b-b8d0-48ab-88d8-01100b6cc363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:06.633388 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5afd9c-066a-41e9-9798-3794d66b597a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:06.634510 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Volume 116c847b-4e23-4992-ab59-ef12019a9b0d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-116c847b-4e23-4992-ab59-ef12019a9b0d', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95919faac0>}
Jul 16 21:36:06.635106 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Cloning 116c847b-4e23-4992-ab59-ef12019a9b0d from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9  at location (None, None). {{(pid=131857) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Jul 16 21:36:06.636139 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Acquiring lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" by "_prepare_image_cache_entry" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:36:06.650306 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:36:06.756102 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 36, 6, 657416)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:36:06.760259 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:36:06.760259 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Found cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Jul 16 21:36:06.760259 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-81a23b85-15f8-4569-a9a3-74aaa45fc48a tempest-VolumesListTestJSON-1072157541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:06.787127 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-81a23b85-15f8-4569-a9a3-74aaa45fc48a tempest-VolumesListTestJSON-1072157541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:06.815592 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-81a23b85-15f8-4569-a9a3-74aaa45fc48a tempest-VolumesListTestJSON-1072157541 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:36:06.819978 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-81a23b85-15f8-4569-a9a3-74aaa45fc48a tempest-VolumesListTestJSON-1072157541 None] Deleted volume successfully.
Jul 16 21:36:06.824940 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" released by "_prepare_image_cache_entry" :: held 0.175s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:36:06.829362 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Attempting to retrieve cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Jul 16 21:36:06.832803 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 36, 6, 829802)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:36:06.833227 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:36:06.833628 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Creating from source image-volume b59b3901-b32a-4d92-81b0-6b99e88e4517 {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Jul 16 21:36:06.845953 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:07.076831 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] creating snapshot='volume-116c847b-4e23-4992-ab59-ef12019a9b0d.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:36:08.255149 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] cloning 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517@volume-116c847b-4e23-4992-ab59-ef12019a9b0d.clone_snap' to 'volume-116c847b-4e23-4992-ab59-ef12019a9b0d' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:36:08.262491 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-6948b7a9-12e8-4996-98f9-b7da76554581 tempest-VolumesListTestJSON-1072157541 None] Acquiring lock "cinder-b125c38c-91f5-47d1-99e0-93ebe05af4b4-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:36:08.290534 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b666ad58-116c-4833-b4b0-81058be3163f tempest-VolumeQuotasAdminTestJSON-4709986 None] Transfer volume completed successfully.
Jul 16 21:36:08.321653 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-6948b7a9-12e8-4996-98f9-b7da76554581 tempest-VolumesListTestJSON-1072157541 None] Lock "cinder-b125c38c-91f5-47d1-99e0-93ebe05af4b4-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:36:08.334440 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-81a23b85-15f8-4569-a9a3-74aaa45fc48a tempest-VolumesListTestJSON-1072157541 None] Lock "cinder-6331801a-9232-4447-810c-28b0c7fd9b38-delete_volume" released by "delete_volume" :: held 8.177s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:36:08.444232 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-980d8a5f-0cbd-4ef9-935c-0c972e2063db tempest-ServersNegativeTestJSON-1102403437 None] Created reservations ['c6221de0-e113-45fd-b299-a29b8479fff4', 'd4d7fa71-1563-4052-bea9-8df1bbba453b', 'a2bbe60a-a4ee-4d46-bd72-d36b8631c3e1', '6edd988f-5133-4329-8455-ed852eb0dc5a'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:36:08.466062 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6948b7a9-12e8-4996-98f9-b7da76554581 tempest-VolumesListTestJSON-1072157541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:08.614914 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6948b7a9-12e8-4996-98f9-b7da76554581 tempest-VolumesListTestJSON-1072157541 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:36:08.615362 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6948b7a9-12e8-4996-98f9-b7da76554581 tempest-VolumesListTestJSON-1072157541 None] Volume volume-b125c38c-91f5-47d1-99e0-93ebe05af4b4 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:36:08.774742 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6948b7a9-12e8-4996-98f9-b7da76554581 tempest-VolumesListTestJSON-1072157541 None] deleting rbd volume volume-b125c38c-91f5-47d1-99e0-93ebe05af4b4 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:36:08.888938 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=36,cinder:SELECT=54,cinder:INSERT=8,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:36:09.005224 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-980d8a5f-0cbd-4ef9-935c-0c972e2063db tempest-ServersNegativeTestJSON-1102403437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:09.038574 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-980d8a5f-0cbd-4ef9-935c-0c972e2063db tempest-ServersNegativeTestJSON-1102403437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:09.063249 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-980d8a5f-0cbd-4ef9-935c-0c972e2063db tempest-ServersNegativeTestJSON-1102403437 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:36:09.067866 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-980d8a5f-0cbd-4ef9-935c-0c972e2063db tempest-ServersNegativeTestJSON-1102403437 None] Deleted volume successfully.
Jul 16 21:36:09.194456 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-980d8a5f-0cbd-4ef9-935c-0c972e2063db tempest-ServersNegativeTestJSON-1102403437 None] Lock "cinder-6067192a-2bc9-4dce-ac75-d0ecdcbbbd48-delete_volume" released by "delete_volume" :: held 7.825s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:36:09.323748 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-59b21800-36ed-4d44-8eba-8a83afdb9e7b tempest-ServersNegativeTestJSON-1102403437 None] Acquiring lock "cinder-75978d6a-3102-4e0e-bde6-0442de5a8d0a-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:36:09.338033 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-59b21800-36ed-4d44-8eba-8a83afdb9e7b tempest-ServersNegativeTestJSON-1102403437 None] Lock "cinder-75978d6a-3102-4e0e-bde6-0442de5a8d0a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:36:09.421933 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-aa36267f-f4a0-470d-811b-b7aabae765c0 tempest-VolumeQuotasAdminTestJSON-1676886089 None] Acquiring lock "cinder-832da595-24c8-48e3-9799-6294804fbab5-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:36:09.443317 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-aa36267f-f4a0-470d-811b-b7aabae765c0 tempest-VolumeQuotasAdminTestJSON-1676886089 None] Lock "cinder-832da595-24c8-48e3-9799-6294804fbab5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:36:09.501532 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945.deleted is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:36:09.504849 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:36:09.513488 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:36:09.994491 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:36:09.995223 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Marking volume 116c847b-4e23-4992-ab59-ef12019a9b0d as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:36:10.001552 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-59b21800-36ed-4d44-8eba-8a83afdb9e7b tempest-ServersNegativeTestJSON-1102403437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:10.282626 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-59b21800-36ed-4d44-8eba-8a83afdb9e7b tempest-ServersNegativeTestJSON-1102403437 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:36:10.283091 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-59b21800-36ed-4d44-8eba-8a83afdb9e7b tempest-ServersNegativeTestJSON-1102403437 None] Volume volume-75978d6a-3102-4e0e-bde6-0442de5a8d0a is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:36:10.478318 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-59b21800-36ed-4d44-8eba-8a83afdb9e7b tempest-ServersNegativeTestJSON-1102403437 None] deleting rbd volume volume-75978d6a-3102-4e0e-bde6-0442de5a8d0a {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:36:10.577748 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Copying metadata from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 to 116c847b-4e23-4992-ab59-ef12019a9b0d. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Jul 16 21:36:10.578176 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Creating volume glance metadata for volume 116c847b-4e23-4992-ab59-ef12019a9b0d backed by image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131857) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Jul 16 21:36:10.592477 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-aa36267f-f4a0-470d-811b-b7aabae765c0 tempest-VolumeQuotasAdminTestJSON-1676886089 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:10.745444 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-aa36267f-f4a0-470d-811b-b7aabae765c0 tempest-VolumeQuotasAdminTestJSON-1676886089 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:36:10.745791 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-aa36267f-f4a0-470d-811b-b7aabae765c0 tempest-VolumeQuotasAdminTestJSON-1676886089 None] Volume volume-832da595-24c8-48e3-9799-6294804fbab5 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:36:10.934401 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-aa36267f-f4a0-470d-811b-b7aabae765c0 tempest-VolumeQuotasAdminTestJSON-1676886089 None] deleting rbd volume volume-832da595-24c8-48e3-9799-6294804fbab5 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:36:11.062509 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5afd9c-066a-41e9-9798-3794d66b597a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-116c847b-4e23-4992-ab59-ef12019a9b0d', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95919faac0>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:11.067251 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9868f081-d7b5-4a26-9520-f0435b331cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:11.155475 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Volume volume-116c847b-4e23-4992-ab59-ef12019a9b0d (116c847b-4e23-4992-ab59-ef12019a9b0d): created successfully
Jul 16 21:36:11.159210 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9868f081-d7b5-4a26-9520-f0435b331cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:11.165340 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Flow 'volume_create_manager' (d9ad3b19-89e5-4b6a-8e34-20f32727d56a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:36:11.273029 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-12912483-77ff-4d90-aa83-7feb736668c1 tempest-VolumesExtendTest-60344842 None] Created volume successfully.
Jul 16 21:36:11.565915 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1d64441b-95db-4879-9009-ae4bbe5c7835 tempest-VolumesExtendTest-60344842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:13.214262 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1d64441b-95db-4879-9009-ae4bbe5c7835 tempest-VolumesExtendTest-60344842 None] Extend volume from 1 GB to 2 GB. {{(pid=131857) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1878}}
Jul 16 21:36:13.408797 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-1d64441b-95db-4879-9009-ae4bbe5c7835 tempest-VolumesExtendTest-60344842 None] Extend volume completed successfully.
Jul 16 21:36:14.107351 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-6948b7a9-12e8-4996-98f9-b7da76554581 tempest-VolumesListTestJSON-1072157541 None] Created reservations ['f326b772-cdb3-41ef-aa6b-2bbfc1d5fa33', '332598ca-9775-4cf9-b89f-3fb208d5844e', '5dd22e8c-1187-4a7a-b481-9e0319d51473', '4275b42d-de27-4568-8a04-d582ba4b882f'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:36:14.335512 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6948b7a9-12e8-4996-98f9-b7da76554581 tempest-VolumesListTestJSON-1072157541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:14.368752 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6948b7a9-12e8-4996-98f9-b7da76554581 tempest-VolumesListTestJSON-1072157541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:14.398261 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-6948b7a9-12e8-4996-98f9-b7da76554581 tempest-VolumesListTestJSON-1072157541 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:36:14.402628 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-6948b7a9-12e8-4996-98f9-b7da76554581 tempest-VolumesListTestJSON-1072157541 None] Deleted volume successfully.
Jul 16 21:36:14.545487 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-6948b7a9-12e8-4996-98f9-b7da76554581 tempest-VolumesListTestJSON-1072157541 None] Lock "cinder-b125c38c-91f5-47d1-99e0-93ebe05af4b4-delete_volume" released by "delete_volume" :: held 6.224s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:36:14.592767 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-4d1de158-b7a1-4cb8-b4b5-eaabc3715381 tempest-VolumesListTestJSON-1072157541 None] Acquiring lock "cinder-7d4b816c-5436-4be5-a7dc-a2131cbe5207-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:36:14.604921 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-4d1de158-b7a1-4cb8-b4b5-eaabc3715381 tempest-VolumesListTestJSON-1072157541 None] Lock "cinder-7d4b816c-5436-4be5-a7dc-a2131cbe5207-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:36:14.745760 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4d1de158-b7a1-4cb8-b4b5-eaabc3715381 tempest-VolumesListTestJSON-1072157541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:14.934241 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4d1de158-b7a1-4cb8-b4b5-eaabc3715381 tempest-VolumesListTestJSON-1072157541 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:36:14.938884 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4d1de158-b7a1-4cb8-b4b5-eaabc3715381 tempest-VolumesListTestJSON-1072157541 None] Volume volume-7d4b816c-5436-4be5-a7dc-a2131cbe5207 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:36:15.110881 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4d1de158-b7a1-4cb8-b4b5-eaabc3715381 tempest-VolumesListTestJSON-1072157541 None] deleting rbd volume volume-7d4b816c-5436-4be5-a7dc-a2131cbe5207 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:36:15.194897 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:36:15.214501 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Flow 'volume_create_manager' (d4b2b1b8-0917-4f42-b413-813382448475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:36:15.220818 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7ac09a-e079-4228-a9f3-9a13347fcebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:15.237908 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7ac09a-e079-4228-a9f3-9a13347fcebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-655512701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=de6925fd-92f2-432c-be37-384d3167260c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bc69aef04a436498a38c4f1efaf88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:36:15Z,use_quota=True,user_id='a691f131ccef4fb4989137852816abc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:15.243131 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a845887-b45a-428b-925a-9de2ef7ac0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:15.247169 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a845887-b45a-428b-925a-9de2ef7ac0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:15.252086 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a69e42-2994-4089-b610-0b02c0250b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:15.256252 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a69e42-2994-4089-b610-0b02c0250b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de6925fd-92f2-432c-be37-384d3167260c', 'volume_name': 'volume-de6925fd-92f2-432c-be37-384d3167260c', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:15.261025 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e52a887-8fe7-4d5e-b653-e291db9d41b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:15.267092 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e52a887-8fe7-4d5e-b653-e291db9d41b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:15.269376 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3deb5561-a615-49be-b00d-011d1b90a2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:15.270425 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Volume de6925fd-92f2-432c-be37-384d3167260c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de6925fd-92f2-432c-be37-384d3167260c', 'volume_size': 1}
Jul 16 21:36:15.271475 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] creating volume 'volume-de6925fd-92f2-432c-be37-384d3167260c' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:36:15.272384 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:16.213350 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:36:16.213977 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:36:16.217229 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3deb5561-a615-49be-b00d-011d1b90a2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de6925fd-92f2-432c-be37-384d3167260c', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:16.221652 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521af861-72a4-438d-82d0-e5a9326d7bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:16.276688 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=65,cinder:DELETE=3,cinder:UPDATE=15,cinder:INSERT=17 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:36:16.288625 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Volume volume-de6925fd-92f2-432c-be37-384d3167260c (de6925fd-92f2-432c-be37-384d3167260c): created successfully
Jul 16 21:36:16.292172 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521af861-72a4-438d-82d0-e5a9326d7bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:16.297347 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Flow 'volume_create_manager' (d4b2b1b8-0917-4f42-b413-813382448475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:36:16.362791 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e3f70993-4552-47a3-a317-e656cca165e4 tempest-VolumesExtendTest-60344842 None] Created volume successfully.
Jul 16 21:36:16.395435 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-aa36267f-f4a0-470d-811b-b7aabae765c0 tempest-VolumeQuotasAdminTestJSON-1676886089 None] Created reservations ['a1a55fcc-4ab3-49ca-a019-20b71dd9e3b2', 'ebbe7127-1b66-4661-9eef-c15e11e99047', '3ee0fa9b-9f56-4d6a-8486-523653376a0c', '79f42143-ea30-4a9a-90c3-bedcaffe713c'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:36:16.399762 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-59b21800-36ed-4d44-8eba-8a83afdb9e7b tempest-ServersNegativeTestJSON-1102403437 None] Created reservations ['e2269ebb-6e41-403f-840f-9d7510f4efa9', '7b14dc21-734c-416e-b731-58930aeb3f6d', 'e81163ab-8c85-4192-82d6-397e3a353314', '4b3542e3-26ee-41c6-b517-1578a2bc461a'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:36:16.682180 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-59b21800-36ed-4d44-8eba-8a83afdb9e7b tempest-ServersNegativeTestJSON-1102403437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:16.710855 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-59b21800-36ed-4d44-8eba-8a83afdb9e7b tempest-ServersNegativeTestJSON-1102403437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:16.742113 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-59b21800-36ed-4d44-8eba-8a83afdb9e7b tempest-ServersNegativeTestJSON-1102403437 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:36:16.750863 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-59b21800-36ed-4d44-8eba-8a83afdb9e7b tempest-ServersNegativeTestJSON-1102403437 None] Deleted volume successfully.
Jul 16 21:36:16.881582 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-59b21800-36ed-4d44-8eba-8a83afdb9e7b tempest-ServersNegativeTestJSON-1102403437 None] Lock "cinder-75978d6a-3102-4e0e-bde6-0442de5a8d0a-delete_volume" released by "delete_volume" :: held 7.534s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:36:17.026317 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-aa36267f-f4a0-470d-811b-b7aabae765c0 tempest-VolumeQuotasAdminTestJSON-1676886089 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:17.061322 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-aa36267f-f4a0-470d-811b-b7aabae765c0 tempest-VolumeQuotasAdminTestJSON-1676886089 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:17.088761 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-aa36267f-f4a0-470d-811b-b7aabae765c0 tempest-VolumeQuotasAdminTestJSON-1676886089 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:36:17.092544 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-aa36267f-f4a0-470d-811b-b7aabae765c0 tempest-VolumeQuotasAdminTestJSON-1676886089 None] Deleted volume successfully.
Jul 16 21:36:17.211386 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-aa36267f-f4a0-470d-811b-b7aabae765c0 tempest-VolumeQuotasAdminTestJSON-1676886089 None] Lock "cinder-832da595-24c8-48e3-9799-6294804fbab5-delete_volume" released by "delete_volume" :: held 7.768s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:36:17.330249 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=44,cinder:UPDATE=46,cinder:INSERT=7,cinder:DELETE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:36:17.340815 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-91f79b9f-da7e-4606-8f1a-25d837c20006 tempest-VolumesExtendTest-60344842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:18.813170 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-4d1de158-b7a1-4cb8-b4b5-eaabc3715381 tempest-VolumesListTestJSON-1072157541 None] Created reservations ['37d02bf5-a83f-4abe-9096-c5d9488acdcb', '95bf832a-05f4-44ed-94f7-11441dee63c5', '6b7f6b59-6828-4fdc-9a38-4f5c6fb28af5', '295bf827-d5f7-445a-a6a9-736583556e41'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:36:19.076769 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4d1de158-b7a1-4cb8-b4b5-eaabc3715381 tempest-VolumesListTestJSON-1072157541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:19.131302 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4d1de158-b7a1-4cb8-b4b5-eaabc3715381 tempest-VolumesListTestJSON-1072157541 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:19.159170 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-4d1de158-b7a1-4cb8-b4b5-eaabc3715381 tempest-VolumesListTestJSON-1072157541 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:36:19.164468 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-4d1de158-b7a1-4cb8-b4b5-eaabc3715381 tempest-VolumesListTestJSON-1072157541 None] Deleted volume successfully.
Jul 16 21:36:19.247823 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-4d1de158-b7a1-4cb8-b4b5-eaabc3715381 tempest-VolumesListTestJSON-1072157541 None] Lock "cinder-7d4b816c-5436-4be5-a7dc-a2131cbe5207-delete_volume" released by "delete_volume" :: held 4.643s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:36:19.551764 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-91f79b9f-da7e-4606-8f1a-25d837c20006 tempest-VolumesExtendTest-60344842 None] Create snapshot completed successfully
Jul 16 21:36:20.564040 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cda082fe-a375-4ff0-b597-ae7d3104bf01 tempest-VolumesExtendTest-60344842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:21.391623 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cda082fe-a375-4ff0-b597-ae7d3104bf01 tempest-VolumesExtendTest-60344842 None] Extend volume from 1 GB to 2 GB. {{(pid=131857) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1878}}
Jul 16 21:36:21.744116 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-cda082fe-a375-4ff0-b597-ae7d3104bf01 tempest-VolumesExtendTest-60344842 None] Extend volume completed successfully.
Jul 16 21:36:22.994559 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3c5785df-dcf0-4c15-908b-8ac7772fb56e tempest-VolumesExtendTest-60344842 None] Acquiring lock "cinder-d745b710-dbc0-4b9a-a017-a61230a2432a-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:36:23.032174 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3c5785df-dcf0-4c15-908b-8ac7772fb56e tempest-VolumesExtendTest-60344842 None] Lock "cinder-d745b710-dbc0-4b9a-a017-a61230a2432a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:36:23.035494 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3c5785df-dcf0-4c15-908b-8ac7772fb56e tempest-VolumesExtendTest-60344842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:25.392432 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-3c5785df-dcf0-4c15-908b-8ac7772fb56e tempest-VolumesExtendTest-60344842 None] Created reservations ['c81ac5ce-3c26-43fc-92d8-0bb2cbc59288', '44bf4a26-c809-4d1d-914e-368b847b61ba', '541de6ce-04f2-4768-9b81-34ffd2094507', 'e6045eb8-b679-45fa-92d2-100c3641f70a'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:36:25.638407 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-3c5785df-dcf0-4c15-908b-8ac7772fb56e tempest-VolumesExtendTest-60344842 None] Delete snapshot completed successfully.
Jul 16 21:36:25.648510 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3c5785df-dcf0-4c15-908b-8ac7772fb56e tempest-VolumesExtendTest-60344842 None] Lock "cinder-d745b710-dbc0-4b9a-a017-a61230a2432a-delete_snapshot" released by "delete_snapshot" :: held 2.612s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:36:26.313059 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:36:26.358456 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Flow 'volume_create_manager' (2b310953-c6b9-4f93-af91-69e84695db8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:36:26.362964 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd64ab7e-4d33-4253-9dee-da2bee730b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:26.381477 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd64ab7e-4d33-4253-9dee-da2bee730b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1530055568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=77db5a1b-4fec-4112-88ee-174b21741afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed28a2c5cfd241d9ac065ed49746acef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:36:26Z,use_quota=True,user_id='8d681f1ba4214188a35667a47473633e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:26.390237 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6049a6e4-09a5-4b0f-a646-3b7e896a3bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:26.392547 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6049a6e4-09a5-4b0f-a646-3b7e896a3bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:26.399578 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b8d3dc6-a208-4b0e-85b8-9e9c807d2d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:26.404220 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b8d3dc6-a208-4b0e-85b8-9e9c807d2d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77db5a1b-4fec-4112-88ee-174b21741afe', 'volume_name': 'volume-77db5a1b-4fec-4112-88ee-174b21741afe', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:26.409715 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378a5ff7-54ee-4a68-a3e6-92651413887c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:26.414751 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378a5ff7-54ee-4a68-a3e6-92651413887c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:26.419610 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece44533-fb82-4d56-9a59-f6e8c383d06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:26.420767 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Volume 77db5a1b-4fec-4112-88ee-174b21741afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77db5a1b-4fec-4112-88ee-174b21741afe', 'volume_size': 1}
Jul 16 21:36:26.421169 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] creating volume 'volume-77db5a1b-4fec-4112-88ee-174b21741afe' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:36:26.422246 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:26.506009 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e4176661-3dff-4918-bd7e-52b8a5907e7a tempest-VolumesExtendTest-60344842 None] Acquiring lock "cinder-de6925fd-92f2-432c-be37-384d3167260c-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:36:26.539898 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e4176661-3dff-4918-bd7e-52b8a5907e7a tempest-VolumesExtendTest-60344842 None] Lock "cinder-de6925fd-92f2-432c-be37-384d3167260c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:36:26.673521 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:36:26.693442 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Flow 'volume_create_manager' (c33af4a4-a3ca-447d-a291-9afea07f03f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:36:26.699704 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4e0a67-28f0-4ab8-89b9-072f6652fc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:26.722565 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4e0a67-28f0-4ab8-89b9-072f6652fc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1925919262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f4e6fb31-921e-4c81-bf9b-833752a58dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56b8099d9406431284b4dd58b5c16359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:36:26Z,use_quota=True,user_id='95cd6b54d8164de1a524b407a1852ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:26.728427 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc35106d-31ef-49bd-9675-4897f295037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:26.732740 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc35106d-31ef-49bd-9675-4897f295037a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:26.737819 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ecc75e-38e8-49f3-8dbe-9fbd69f5e921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:26.742495 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ecc75e-38e8-49f3-8dbe-9fbd69f5e921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e6fb31-921e-4c81-bf9b-833752a58dfc', 'volume_name': 'volume-f4e6fb31-921e-4c81-bf9b-833752a58dfc', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:26.747370 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d76f6cbb-1cd5-45df-81a0-866d988144be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:26.751209 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d76f6cbb-1cd5-45df-81a0-866d988144be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:26.755877 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f705696-0643-486c-96a5-c15b129235e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:26.756905 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Volume f4e6fb31-921e-4c81-bf9b-833752a58dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e6fb31-921e-4c81-bf9b-833752a58dfc', 'volume_size': 1}
Jul 16 21:36:26.757295 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] creating volume 'volume-f4e6fb31-921e-4c81-bf9b-833752a58dfc' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:36:26.757936 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:26.789534 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e4176661-3dff-4918-bd7e-52b8a5907e7a tempest-VolumesExtendTest-60344842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:26.914143 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e4176661-3dff-4918-bd7e-52b8a5907e7a tempest-VolumesExtendTest-60344842 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:36:26.914573 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e4176661-3dff-4918-bd7e-52b8a5907e7a tempest-VolumesExtendTest-60344842 None] Volume volume-de6925fd-92f2-432c-be37-384d3167260c is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:36:27.146551 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e4176661-3dff-4918-bd7e-52b8a5907e7a tempest-VolumesExtendTest-60344842 None] deleting rbd volume volume-de6925fd-92f2-432c-be37-384d3167260c {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:36:27.151756 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:36:27.152295 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:36:27.156009 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece44533-fb82-4d56-9a59-f6e8c383d06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77db5a1b-4fec-4112-88ee-174b21741afe', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:27.160442 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea587c40-3bec-4f64-aa97-28e059698ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:27.237212 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Volume volume-77db5a1b-4fec-4112-88ee-174b21741afe (77db5a1b-4fec-4112-88ee-174b21741afe): created successfully
Jul 16 21:36:27.241017 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea587c40-3bec-4f64-aa97-28e059698ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:27.247937 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Flow 'volume_create_manager' (2b310953-c6b9-4f93-af91-69e84695db8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:36:27.338643 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e1a4ae32-fd3b-4f4a-bdaf-848dc01b6eaa tempest-VolumesBackupsAdminTest-2094650034 None] Created volume successfully.
Jul 16 21:36:27.539642 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:36:27.540169 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:36:27.543883 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f705696-0643-486c-96a5-c15b129235e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e6fb31-921e-4c81-bf9b-833752a58dfc', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:27.548510 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21080dd3-cb35-4e6a-940a-64c7d37713ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:27.626993 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Volume volume-f4e6fb31-921e-4c81-bf9b-833752a58dfc (f4e6fb31-921e-4c81-bf9b-833752a58dfc): created successfully
Jul 16 21:36:27.631260 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21080dd3-cb35-4e6a-940a-64c7d37713ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:27.637443 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Flow 'volume_create_manager' (c33af4a4-a3ca-447d-a291-9afea07f03f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:36:27.704516 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-3b895f7c-c96b-4e91-b890-9db7b1a1e4ae tempest-VolumesSnapshotTestJSON-1954720325 None] Created volume successfully.
Jul 16 21:36:29.018533 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-42ada744-51c7-428c-8c39-88af6101dc9e tempest-VolumesBackupsAdminTest-2094650034 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-07-16T21:36:28Z,data_timestamp=2022-07-16T21:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-771751154',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=9b9496ce-3437-42e7-9a46-94c67367c4e8,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='ed28a2c5cfd241d9ac065ed49746acef',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='8d681f1ba4214188a35667a47473633e',volume_id=77db5a1b-4fec-4112-88ee-174b21741afe)
Jul 16 21:36:29.020050 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.backup.rpcapi [None req-42ada744-51c7-428c-8c39-88af6101dc9e tempest-VolumesBackupsAdminTest-2094650034 None] continue_backup in rpcapi backup_id 9b9496ce-3437-42e7-9a46-94c67367c4e8 {{(pid=131857) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Jul 16 21:36:29.193944 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-42ada744-51c7-428c-8c39-88af6101dc9e tempest-VolumesBackupsAdminTest-2094650034 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:36:29.336569 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ce616f9a-b914-4a62-8fca-836758150fde tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:29.964772 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-42ada744-51c7-428c-8c39-88af6101dc9e tempest-VolumesBackupsAdminTest-2094650034 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.771s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:36:29.965457 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-42ada744-51c7-428c-8c39-88af6101dc9e tempest-VolumesBackupsAdminTest-2094650034 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-77db5a1b-4fec-4112-88ee-174b21741afe', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '77db5a1b-4fec-4112-88ee-174b21741afe', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:36:29.982125 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-42ada744-51c7-428c-8c39-88af6101dc9e tempest-VolumesBackupsAdminTest-2094650034 None] Initialize volume connection completed successfully.
Jul 16 21:36:30.284881 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:36:30.305772 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Flow 'volume_create_manager' (84313fe8-571c-4d16-a3a9-006885f208b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:36:30.312089 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff122b1-9dba-49a2-bea9-dd0d4113f4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:30.328560 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff122b1-9dba-49a2-bea9-dd0d4113f4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-936803171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=64cfebc6-4a34-42c3-8e38-188693d74ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60c0863dc6f4313bdc873fda27ae2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:36:30Z,use_quota=True,user_id='0ab8b3f06e994bbca5d6dd14109bfe50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:30.334579 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72dd89f9-b4f9-4472-b793-ac4bfd0fe299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:30.338622 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72dd89f9-b4f9-4472-b793-ac4bfd0fe299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:30.343525 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d046c09-7e48-4b07-a0fa-e271df23223e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:30.347492 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d046c09-7e48-4b07-a0fa-e271df23223e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64cfebc6-4a34-42c3-8e38-188693d74ff7', 'volume_name': 'volume-64cfebc6-4a34-42c3-8e38-188693d74ff7', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:30.352416 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d2d2e0-1399-4bc3-bdf7-4aae8979183e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:30.356552 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d2d2e0-1399-4bc3-bdf7-4aae8979183e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:30.361057 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124d5687-a60a-446c-8e22-71f37b6de89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:30.362146 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Volume 64cfebc6-4a34-42c3-8e38-188693d74ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64cfebc6-4a34-42c3-8e38-188693d74ff7', 'volume_size': 1}
Jul 16 21:36:30.367247 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] creating volume 'volume-64cfebc6-4a34-42c3-8e38-188693d74ff7' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:36:30.367247 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:30.552919 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-e4176661-3dff-4918-bd7e-52b8a5907e7a tempest-VolumesExtendTest-60344842 None] Created reservations ['61f9db5c-1035-4398-948e-8cde936ecb38', '76118b4c-8d38-4c40-b005-4951d452099c', 'f359d675-4bf9-4a6c-95ff-93ead32015f7', '8087ff58-dd3e-45c0-8e6e-4978731f4c6e'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:36:30.680365 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=55,cinder:INSERT=8,cinder:UPDATE=35,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:36:30.785136 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e4176661-3dff-4918-bd7e-52b8a5907e7a tempest-VolumesExtendTest-60344842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:30.900329 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e4176661-3dff-4918-bd7e-52b8a5907e7a tempest-VolumesExtendTest-60344842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:30.954862 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-e4176661-3dff-4918-bd7e-52b8a5907e7a tempest-VolumesExtendTest-60344842 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:36:30.968335 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e4176661-3dff-4918-bd7e-52b8a5907e7a tempest-VolumesExtendTest-60344842 None] Deleted volume successfully.
Jul 16 21:36:31.094025 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e4176661-3dff-4918-bd7e-52b8a5907e7a tempest-VolumesExtendTest-60344842 None] Lock "cinder-de6925fd-92f2-432c-be37-384d3167260c-delete_volume" released by "delete_volume" :: held 4.554s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:36:31.232948 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-754bf14c-697e-46cf-8640-398e279a33fd tempest-VolumesExtendTest-60344842 None] Acquiring lock "cinder-116c847b-4e23-4992-ab59-ef12019a9b0d-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:36:31.243609 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-754bf14c-697e-46cf-8640-398e279a33fd tempest-VolumesExtendTest-60344842 None] Lock "cinder-116c847b-4e23-4992-ab59-ef12019a9b0d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:36:31.282388 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:36:31.287450 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:36:31.287450 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124d5687-a60a-446c-8e22-71f37b6de89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64cfebc6-4a34-42c3-8e38-188693d74ff7', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:31.292189 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f04a16-92c5-429f-8a5e-eafbbeaae651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:31.347542 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-754bf14c-697e-46cf-8640-398e279a33fd tempest-VolumesExtendTest-60344842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:31.544264 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-754bf14c-697e-46cf-8640-398e279a33fd tempest-VolumesExtendTest-60344842 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:36:31.701684 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-754bf14c-697e-46cf-8640-398e279a33fd tempest-VolumesExtendTest-60344842 None] deleting rbd volume volume-116c847b-4e23-4992-ab59-ef12019a9b0d {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:36:31.705106 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Volume volume-64cfebc6-4a34-42c3-8e38-188693d74ff7 (64cfebc6-4a34-42c3-8e38-188693d74ff7): created successfully
Jul 16 21:36:31.709159 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f04a16-92c5-429f-8a5e-eafbbeaae651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:31.714636 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Flow 'volume_create_manager' (84313fe8-571c-4d16-a3a9-006885f208b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:36:31.820218 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-cbabbef6-a1bd-4444-8a75-5f76d9ffe37b tempest-AttachVolumeNegativeTest-17004004 None] Created volume successfully.
Jul 16 21:36:32.542185 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=66,cinder:DELETE=4,cinder:UPDATE=26,cinder:INSERT=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:36:32.643662 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-ce616f9a-b914-4a62-8fca-836758150fde tempest-VolumesSnapshotTestJSON-1954720325 None] Create snapshot completed successfully
Jul 16 21:36:33.231935 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-4c63b404-f927-4cde-a423-a2b69ca91ad2 req-6f065efe-e628-499f-ad8f-7864ed22c094 tempest-AttachVolumeNegativeTest-17004004 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:36:34.092523 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.driver [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] Creating a new backup for volume volume-f4e6fb31-921e-4c81-bf9b-833752a58dfc. {{(pid=131857) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1213}}
Jul 16 21:36:34.136344 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-4c63b404-f927-4cde-a423-a2b69ca91ad2 req-6f065efe-e628-499f-ad8f-7864ed22c094 tempest-AttachVolumeNegativeTest-17004004 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.904s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:36:34.137110 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-4c63b404-f927-4cde-a423-a2b69ca91ad2 req-6f065efe-e628-499f-ad8f-7864ed22c094 tempest-AttachVolumeNegativeTest-17004004 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-64cfebc6-4a34-42c3-8e38-188693d74ff7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '64cfebc6-4a34-42c3-8e38-188693d74ff7', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:36:34.205046 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] cloning volumes/volume-f4e6fb31-921e-4c81-bf9b-833752a58dfc@snapshot-cab71f74-7ac8-4e50-9f1a-f2123f3767a2 to volume-9496212f-0db2-4ff7-85ef-4f825a75c1d9 {{(pid=131857) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}}
Jul 16 21:36:34.205976 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:34.252058 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:34.288561 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-4c63b404-f927-4cde-a423-a2b69ca91ad2 req-6f065efe-e628-499f-ad8f-7864ed22c094 tempest-AttachVolumeNegativeTest-17004004 None] Connection info returned from driver {'name': 'volumes/volume-64cfebc6-4a34-42c3-8e38-188693d74ff7', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '64cfebc6-4a34-42c3-8e38-188693d74ff7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd6ea954e-7ffe-414c-b894-a6513c1244bd'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:36:34.451147 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-4c63b404-f927-4cde-a423-a2b69ca91ad2 req-6f065efe-e628-499f-ad8f-7864ed22c094 tempest-AttachVolumeNegativeTest-17004004 None] attachment_update completed successfully.
Jul 16 21:36:35.817520 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:36:35.818692 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:36:36.192774 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-07-16T21:36:33Z,data_timestamp=2022-07-16T21:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-1052324487',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=f3f3e905-6285-4769-b32d-f9a0793dae35,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='56b8099d9406431284b4dd58b5c16359',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='cab71f74-7ac8-4e50-9f1a-f2123f3767a2',status='creating',temp_snapshot_id=None,temp_volume_id='9496212f-0db2-4ff7-85ef-4f825a75c1d9',updated_at=None,user_id='95cd6b54d8164de1a524b407a1852ebd',volume_id=f4e6fb31-921e-4c81-bf9b-833752a58dfc)
Jul 16 21:36:36.193729 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.backup.rpcapi [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] continue_backup in rpcapi backup_id f3f3e905-6285-4769-b32d-f9a0793dae35 {{(pid=131857) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Jul 16 21:36:36.255975 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-42ada744-51c7-428c-8c39-88af6101dc9e tempest-VolumesBackupsAdminTest-2094650034 None] Terminate volume connection completed successfully.
Jul 16 21:36:36.278565 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-42ada744-51c7-428c-8c39-88af6101dc9e tempest-VolumesBackupsAdminTest-2094650034 None] Remove volume export completed successfully.
Jul 16 21:36:36.372625 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:36:36.783321 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:36:36.784832 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:36.826214 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:36.887363 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:36:36.902349 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-754bf14c-697e-46cf-8640-398e279a33fd tempest-VolumesExtendTest-60344842 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:36:37.021988 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-754bf14c-697e-46cf-8640-398e279a33fd tempest-VolumesExtendTest-60344842 None] deleting parent snapshot volume-116c847b-4e23-4992-ab59-ef12019a9b0d.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:36:39.876592 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 3.504s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:36:39.879338 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9496212f-0db2-4ff7-85ef-4f825a75c1d9', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '9496212f-0db2-4ff7-85ef-4f825a75c1d9', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:36:39.904276 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] Initialize volume connection completed successfully.
Jul 16 21:36:40.001752 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-754bf14c-697e-46cf-8640-398e279a33fd tempest-VolumesExtendTest-60344842 None] Created reservations ['37943b5b-e794-4e85-8649-f0584a1321fc', 'aebd0797-3cc2-4850-b884-1614e5490a88', '61fe5170-44d1-40cd-a027-2372fc6d3e74', 'c6c8b074-5774-431e-a97a-d8cdf03a8312'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:36:40.206219 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-754bf14c-697e-46cf-8640-398e279a33fd tempest-VolumesExtendTest-60344842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:40.246952 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-754bf14c-697e-46cf-8640-398e279a33fd tempest-VolumesExtendTest-60344842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:40.278531 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-754bf14c-697e-46cf-8640-398e279a33fd tempest-VolumesExtendTest-60344842 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:36:40.293026 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-754bf14c-697e-46cf-8640-398e279a33fd tempest-VolumesExtendTest-60344842 None] Deleted volume successfully.
Jul 16 21:36:40.487711 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-754bf14c-697e-46cf-8640-398e279a33fd tempest-VolumesExtendTest-60344842 None] Lock "cinder-116c847b-4e23-4992-ab59-ef12019a9b0d-delete_volume" released by "delete_volume" :: held 9.198s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:36:40.487711 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:36:40.487711 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Flow 'volume_create_manager' (20a28ae5-7b7c-40ef-a353-8adee70fb951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:36:40.490684 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfc709d-9456-4596-9e8a-ae081485fc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:40.507554 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfc709d-9456-4596-9e8a-ae081485fc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:36:40Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_9b9496ce-3437-42e7-9a46-94c67367c4e8',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=65bd3f27-ce02-4794-9725-635229b44326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed28a2c5cfd241d9ac065ed49746acef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:36:40Z,use_quota=True,user_id='8d681f1ba4214188a35667a47473633e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:40.512802 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21ec8a9-a811-4464-b582-31d57c553457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:40.516896 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21ec8a9-a811-4464-b582-31d57c553457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:40.521902 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814c2ba5-fc86-41ec-b8ce-0247ff46d670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:40.525880 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814c2ba5-fc86-41ec-b8ce-0247ff46d670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65bd3f27-ce02-4794-9725-635229b44326', 'volume_name': 'volume-65bd3f27-ce02-4794-9725-635229b44326', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:40.530687 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38eef609-ced0-45f6-b518-5fc26a2e91fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:40.534499 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38eef609-ced0-45f6-b518-5fc26a2e91fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:40.539398 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1709070-2593-4cbc-adcf-53c82728c008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:40.544744 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Volume 65bd3f27-ce02-4794-9725-635229b44326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65bd3f27-ce02-4794-9725-635229b44326', 'volume_size': 1}
Jul 16 21:36:40.544744 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] creating volume 'volume-65bd3f27-ce02-4794-9725-635229b44326' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:36:40.544744 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:41.277111 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:36:41.277684 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:36:41.282510 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1709070-2593-4cbc-adcf-53c82728c008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65bd3f27-ce02-4794-9725-635229b44326', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:41.295296 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d52dbe0-9231-4fc9-a498-d400078feff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:41.409623 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Volume volume-65bd3f27-ce02-4794-9725-635229b44326 (65bd3f27-ce02-4794-9725-635229b44326): created successfully
Jul 16 21:36:41.414389 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d52dbe0-9231-4fc9-a498-d400078feff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:41.422059 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Flow 'volume_create_manager' (20a28ae5-7b7c-40ef-a353-8adee70fb951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:36:41.508091 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Created volume successfully.
Jul 16 21:36:42.426367 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:36:43.279855 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.853s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:36:43.280785 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-65bd3f27-ce02-4794-9725-635229b44326', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '65bd3f27-ce02-4794-9725-635229b44326', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:36:43.324192 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Initialize volume connection completed successfully.
Jul 16 21:36:44.400053 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:36:44.424694 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Flow 'volume_create_manager' (b6d0c7b7-3192-4d8e-b754-7b0b3e124da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:36:44.431305 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a372c96a-1e1c-4dd2-8a0f-fefc541ac0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:44.449871 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a372c96a-1e1c-4dd2-8a0f-fefc541ac0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-461409373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2982de59-7d9e-41db-bf2f-0aa95ea44aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbb367bc7a20470f9af2e1387f654d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:36:44Z,use_quota=True,user_id='27dd59929c0e400983543373d4ba0a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:44.454482 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf4eeec-30b7-492f-8fd4-d84d2c5c9488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:44.460059 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf4eeec-30b7-492f-8fd4-d84d2c5c9488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:44.465142 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55188fd-cd3b-47de-bbb8-e4f89f76d77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:44.469643 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55188fd-cd3b-47de-bbb8-e4f89f76d77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2982de59-7d9e-41db-bf2f-0aa95ea44aa1', 'volume_name': 'volume-2982de59-7d9e-41db-bf2f-0aa95ea44aa1', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:44.475648 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88a1ad2-9bd3-4078-9c7b-4aea057183b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:44.479589 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88a1ad2-9bd3-4078-9c7b-4aea057183b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:44.484545 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11d8bea-c47d-407f-9071-606dbafeb5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:44.485634 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Volume 2982de59-7d9e-41db-bf2f-0aa95ea44aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2982de59-7d9e-41db-bf2f-0aa95ea44aa1', 'volume_size': 1}
Jul 16 21:36:44.486101 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] creating volume 'volume-2982de59-7d9e-41db-bf2f-0aa95ea44aa1' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:36:44.486863 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:45.529137 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:36:45.529774 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:36:45.533177 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11d8bea-c47d-407f-9071-606dbafeb5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2982de59-7d9e-41db-bf2f-0aa95ea44aa1', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:45.539760 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853aa77f-e542-4153-a9d2-b754e7157649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:36:45.641521 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Volume volume-2982de59-7d9e-41db-bf2f-0aa95ea44aa1 (2982de59-7d9e-41db-bf2f-0aa95ea44aa1): created successfully
Jul 16 21:36:45.645131 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853aa77f-e542-4153-a9d2-b754e7157649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:36:45.650876 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Flow 'volume_create_manager' (b6d0c7b7-3192-4d8e-b754-7b0b3e124da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:36:45.804334 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-31e99532-1f21-4d31-8237-39284132b3c5 tempest-VolumesSnapshotListTestJSON-2020005183 None] Created volume successfully.
Jul 16 21:36:47.136259 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b8cb1d46-8875-494f-bab6-d9e259dfd2a1 tempest-VolumesSnapshotListTestJSON-2020005183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:51.328464 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Terminate volume connection completed successfully.
Jul 16 21:36:51.345654 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-dcb55508-2ee2-47ec-8cf9-74811626d6c2 tempest-VolumesBackupsAdminTest-2094650034 None] Remove volume export completed successfully.
Jul 16 21:36:51.824865 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b8cb1d46-8875-494f-bab6-d9e259dfd2a1 tempest-VolumesSnapshotListTestJSON-2020005183 None] Create snapshot completed successfully
Jul 16 21:36:52.831479 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3c52d7e6-3bc3-43ca-9ffc-e8ba6f5d20a7 tempest-VolumesSnapshotListTestJSON-2020005183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:53.198167 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9dedfba9-dc96-4233-9261-18ac92974d15 tempest-VolumesBackupsAdminTest-2094650034 None] Acquiring lock "cinder-65bd3f27-ce02-4794-9725-635229b44326-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:36:53.226917 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9dedfba9-dc96-4233-9261-18ac92974d15 tempest-VolumesBackupsAdminTest-2094650034 None] Lock "cinder-65bd3f27-ce02-4794-9725-635229b44326-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:36:53.349889 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9dedfba9-dc96-4233-9261-18ac92974d15 tempest-VolumesBackupsAdminTest-2094650034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:36:56.680867 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9dedfba9-dc96-4233-9261-18ac92974d15 tempest-VolumesBackupsAdminTest-2094650034 None] Volume volume-65bd3f27-ce02-4794-9725-635229b44326 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:36:57.337009 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9dedfba9-dc96-4233-9261-18ac92974d15 tempest-VolumesBackupsAdminTest-2094650034 None] deleting rbd volume volume-65bd3f27-ce02-4794-9725-635229b44326 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:36:58.557774 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-3c52d7e6-3bc3-43ca-9ffc-e8ba6f5d20a7 tempest-VolumesSnapshotListTestJSON-2020005183 None] Create snapshot completed successfully
Jul 16 21:36:59.472972 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d7ba6271-327d-4580-851a-365ac37c5bba tempest-VolumesSnapshotListTestJSON-2020005183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:37:03.352106 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d7ba6271-327d-4580-851a-365ac37c5bba tempest-VolumesSnapshotListTestJSON-2020005183 None] Create snapshot completed successfully
Jul 16 21:37:04.138389 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=19,cinder:SELECT=70,cinder:DELETE=5,cinder:INSERT=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:37:04.276676 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-9dedfba9-dc96-4233-9261-18ac92974d15 tempest-VolumesBackupsAdminTest-2094650034 None] Created reservations ['ccb044a8-c44c-4ea9-a931-df1e6b1938f2', '23c23c60-8412-42f8-a237-dcb869ddb861', '5aff6ec9-2f13-42ba-9434-960a9cc3a62f', 'b598275c-b5df-455e-a25e-c20bbd93cb73'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:37:04.286324 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-346c2d0d-f53e-4f5f-805d-d99cdbd95ca0 tempest-VolumesSnapshotListTestJSON-2020005183 None] Acquiring lock "cinder-26c0662b-02bc-4f2b-9835-fdaecfb381c2-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:37:04.304589 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=67,cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:37:04.309356 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-346c2d0d-f53e-4f5f-805d-d99cdbd95ca0 tempest-VolumesSnapshotListTestJSON-2020005183 None] Lock "cinder-26c0662b-02bc-4f2b-9835-fdaecfb381c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:37:04.311382 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-346c2d0d-f53e-4f5f-805d-d99cdbd95ca0 tempest-VolumesSnapshotListTestJSON-2020005183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:37:04.850470 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9dedfba9-dc96-4233-9261-18ac92974d15 tempest-VolumesBackupsAdminTest-2094650034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:37:04.888529 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9dedfba9-dc96-4233-9261-18ac92974d15 tempest-VolumesBackupsAdminTest-2094650034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:37:04.915217 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-9dedfba9-dc96-4233-9261-18ac92974d15 tempest-VolumesBackupsAdminTest-2094650034 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:37:04.921556 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-9dedfba9-dc96-4233-9261-18ac92974d15 tempest-VolumesBackupsAdminTest-2094650034 None] Deleted volume successfully.
Jul 16 21:37:04.984796 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9dedfba9-dc96-4233-9261-18ac92974d15 tempest-VolumesBackupsAdminTest-2094650034 None] Lock "cinder-65bd3f27-ce02-4794-9725-635229b44326-delete_volume" released by "delete_volume" :: held 11.758s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:37:08.380565 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-346c2d0d-f53e-4f5f-805d-d99cdbd95ca0 tempest-VolumesSnapshotListTestJSON-2020005183 None] Created reservations ['b98f60d5-8dad-43fc-86f5-2b37ecbdd1e2', 'c0c9cc9a-50fd-4146-b7f9-33990b1eff8c', '589099e4-35b8-4287-aabb-04bc7a5e6745', 'd93881b2-7dfd-4221-bc04-0b43cbdf70f8'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:37:08.717904 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-346c2d0d-f53e-4f5f-805d-d99cdbd95ca0 tempest-VolumesSnapshotListTestJSON-2020005183 None] Delete snapshot completed successfully.
Jul 16 21:37:08.723060 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-346c2d0d-f53e-4f5f-805d-d99cdbd95ca0 tempest-VolumesSnapshotListTestJSON-2020005183 None] Lock "cinder-26c0662b-02bc-4f2b-9835-fdaecfb381c2-delete_snapshot" released by "delete_snapshot" :: held 4.414s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:37:08.834077 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:37:08.855748 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Flow 'volume_create_manager' (0139f6fe-c743-4a7f-abe0-3bfcd14fc977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:37:08.862413 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9a0c7c-63fe-4c12-b483-87ec35fa8eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:37:08.880517 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9a0c7c-63fe-4c12-b483-87ec35fa8eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-107842586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2c28ee7a-347e-40bb-8de5-7dbd8c649be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed28a2c5cfd241d9ac065ed49746acef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:37:09Z,use_quota=True,user_id='8d681f1ba4214188a35667a47473633e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:37:08.886233 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe89478a-4465-4c5a-9d5e-27b61f5d19f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:37:08.893710 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe89478a-4465-4c5a-9d5e-27b61f5d19f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:37:08.897031 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b26d1a6-e1f1-4809-a909-6026e700323c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:37:08.901948 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b26d1a6-e1f1-4809-a909-6026e700323c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c28ee7a-347e-40bb-8de5-7dbd8c649be1', 'volume_name': 'volume-2c28ee7a-347e-40bb-8de5-7dbd8c649be1', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:37:08.906922 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a630c78-94a5-4745-9d35-efdf8b0ec4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:37:08.911187 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a630c78-94a5-4745-9d35-efdf8b0ec4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:37:08.916584 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dee1633-e950-4183-a94c-87c51efb6a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:37:08.922253 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Volume 2c28ee7a-347e-40bb-8de5-7dbd8c649be1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c28ee7a-347e-40bb-8de5-7dbd8c649be1', 'volume_size': 1}
Jul 16 21:37:08.922253 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] creating volume 'volume-2c28ee7a-347e-40bb-8de5-7dbd8c649be1' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:37:08.922253 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:37:09.552855 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:37:09.553540 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:37:09.557107 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dee1633-e950-4183-a94c-87c51efb6a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c28ee7a-347e-40bb-8de5-7dbd8c649be1', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:37:09.561877 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2563ac-86fd-436d-97f0-bd73bf8e0c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:37:09.620649 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-01e750c1-52b3-4d49-9ee2-22b67ce9b2fa tempest-VolumesSnapshotListTestJSON-2020005183 None] Acquiring lock "cinder-6f060e72-4ef0-43cc-aa95-2d35fbb544a4-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:37:09.629128 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-01e750c1-52b3-4d49-9ee2-22b67ce9b2fa tempest-VolumesSnapshotListTestJSON-2020005183 None] Lock "cinder-6f060e72-4ef0-43cc-aa95-2d35fbb544a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:37:09.630580 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-01e750c1-52b3-4d49-9ee2-22b67ce9b2fa tempest-VolumesSnapshotListTestJSON-2020005183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:37:09.935684 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Volume volume-2c28ee7a-347e-40bb-8de5-7dbd8c649be1 (2c28ee7a-347e-40bb-8de5-7dbd8c649be1): created successfully
Jul 16 21:37:09.939292 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2563ac-86fd-436d-97f0-bd73bf8e0c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:37:09.944707 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Flow 'volume_create_manager' (0139f6fe-c743-4a7f-abe0-3bfcd14fc977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:37:10.010436 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-638b2713-fad3-4697-8b92-fb467cb2b650 tempest-VolumesBackupsAdminTest-2094650034 None] Created volume successfully.
Jul 16 21:37:11.373903 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-1eb9d72b-8f04-473e-99c2-a8393ab51ed2 tempest-VolumesBackupsAdminTest-2094650034 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-07-16T21:37:10Z,data_timestamp=2022-07-16T21:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-2015383476',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=bb961cdd-5f35-4c04-a71e-16815b7332ce,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='ed28a2c5cfd241d9ac065ed49746acef',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='8d681f1ba4214188a35667a47473633e',volume_id=2c28ee7a-347e-40bb-8de5-7dbd8c649be1)
Jul 16 21:37:11.374709 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.backup.rpcapi [None req-1eb9d72b-8f04-473e-99c2-a8393ab51ed2 tempest-VolumesBackupsAdminTest-2094650034 None] continue_backup in rpcapi backup_id bb961cdd-5f35-4c04-a71e-16815b7332ce {{(pid=131857) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Jul 16 21:37:11.517352 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-1eb9d72b-8f04-473e-99c2-a8393ab51ed2 tempest-VolumesBackupsAdminTest-2094650034 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:37:12.435887 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-1eb9d72b-8f04-473e-99c2-a8393ab51ed2 tempest-VolumesBackupsAdminTest-2094650034 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.918s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:37:12.441961 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1eb9d72b-8f04-473e-99c2-a8393ab51ed2 tempest-VolumesBackupsAdminTest-2094650034 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2c28ee7a-347e-40bb-8de5-7dbd8c649be1', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '2c28ee7a-347e-40bb-8de5-7dbd8c649be1', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:37:12.466835 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-1eb9d72b-8f04-473e-99c2-a8393ab51ed2 tempest-VolumesBackupsAdminTest-2094650034 None] Initialize volume connection completed successfully.
Jul 16 21:37:15.005115 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-01e750c1-52b3-4d49-9ee2-22b67ce9b2fa tempest-VolumesSnapshotListTestJSON-2020005183 None] Created reservations ['32261201-fb14-4e72-aaab-fc3186fab96f', '938bfe23-ac96-477d-9b36-564113a085f1', 'a639f475-8f3e-48a4-bb97-d7cda36c1bc3', '1fb70bd1-c17e-4389-bec4-744dc8a7246b'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:37:15.243935 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-01e750c1-52b3-4d49-9ee2-22b67ce9b2fa tempest-VolumesSnapshotListTestJSON-2020005183 None] Delete snapshot completed successfully.
Jul 16 21:37:15.248373 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-01e750c1-52b3-4d49-9ee2-22b67ce9b2fa tempest-VolumesSnapshotListTestJSON-2020005183 None] Lock "cinder-6f060e72-4ef0-43cc-aa95-2d35fbb544a4-delete_snapshot" released by "delete_snapshot" :: held 5.619s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:37:15.992585 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8554ed4d-1550-42ab-8ece-b99a115751a0 tempest-VolumesSnapshotListTestJSON-2020005183 None] Acquiring lock "cinder-f65a49fa-f809-4152-809d-9fb7c12a4030-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:37:16.002233 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8554ed4d-1550-42ab-8ece-b99a115751a0 tempest-VolumesSnapshotListTestJSON-2020005183 None] Lock "cinder-f65a49fa-f809-4152-809d-9fb7c12a4030-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:37:16.004159 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8554ed4d-1550-42ab-8ece-b99a115751a0 tempest-VolumesSnapshotListTestJSON-2020005183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:37:21.067297 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-8554ed4d-1550-42ab-8ece-b99a115751a0 tempest-VolumesSnapshotListTestJSON-2020005183 None] Created reservations ['198841c6-9e15-4858-aca9-7c23d4a9291d', '776bfbd6-1924-42ba-8203-737038393c45', '49856070-64b1-4987-8fe6-6337658e82fa', '92741134-5fdc-4712-a18a-7bf47a545af8'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:37:21.278416 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-8554ed4d-1550-42ab-8ece-b99a115751a0 tempest-VolumesSnapshotListTestJSON-2020005183 None] Delete snapshot completed successfully.
Jul 16 21:37:21.287927 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8554ed4d-1550-42ab-8ece-b99a115751a0 tempest-VolumesSnapshotListTestJSON-2020005183 None] Lock "cinder-f65a49fa-f809-4152-809d-9fb7c12a4030-delete_snapshot" released by "delete_snapshot" :: held 5.285s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:37:22.461166 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-df574ed5-be59-4511-b41c-4f10be2324fd tempest-VolumesSnapshotListTestJSON-2020005183 None] Acquiring lock "cinder-2982de59-7d9e-41db-bf2f-0aa95ea44aa1-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:37:22.476582 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-df574ed5-be59-4511-b41c-4f10be2324fd tempest-VolumesSnapshotListTestJSON-2020005183 None] Lock "cinder-2982de59-7d9e-41db-bf2f-0aa95ea44aa1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:37:22.608692 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-df574ed5-be59-4511-b41c-4f10be2324fd tempest-VolumesSnapshotListTestJSON-2020005183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:37:22.986234 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-df574ed5-be59-4511-b41c-4f10be2324fd tempest-VolumesSnapshotListTestJSON-2020005183 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:37:22.987838 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-df574ed5-be59-4511-b41c-4f10be2324fd tempest-VolumesSnapshotListTestJSON-2020005183 None] Volume volume-2982de59-7d9e-41db-bf2f-0aa95ea44aa1 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:37:23.243561 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-df574ed5-be59-4511-b41c-4f10be2324fd tempest-VolumesSnapshotListTestJSON-2020005183 None] deleting rbd volume volume-2982de59-7d9e-41db-bf2f-0aa95ea44aa1 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:37:23.262016 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-1eb9d72b-8f04-473e-99c2-a8393ab51ed2 tempest-VolumesBackupsAdminTest-2094650034 None] Terminate volume connection completed successfully.
Jul 16 21:37:23.281302 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-1eb9d72b-8f04-473e-99c2-a8393ab51ed2 tempest-VolumesBackupsAdminTest-2094650034 None] Remove volume export completed successfully.
Jul 16 21:37:30.455182 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-df574ed5-be59-4511-b41c-4f10be2324fd tempest-VolumesSnapshotListTestJSON-2020005183 None] Created reservations ['3431bb16-14f2-4cda-b1d5-87a3882b13f0', 'ed76a7e5-4167-40d9-8eb4-fcef5c521d01', 'bad05d70-0235-459c-a58f-02998b061ee3', '322dce69-fa3b-412f-9e92-d843173a2276'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:37:30.472627 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=35,cinder:SELECT=56,cinder:DELETE=1,cinder:INSERT=8 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:37:30.656803 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-df574ed5-be59-4511-b41c-4f10be2324fd tempest-VolumesSnapshotListTestJSON-2020005183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:37:30.710243 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-df574ed5-be59-4511-b41c-4f10be2324fd tempest-VolumesSnapshotListTestJSON-2020005183 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:37:30.739102 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-df574ed5-be59-4511-b41c-4f10be2324fd tempest-VolumesSnapshotListTestJSON-2020005183 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:37:30.745315 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-df574ed5-be59-4511-b41c-4f10be2324fd tempest-VolumesSnapshotListTestJSON-2020005183 None] Deleted volume successfully.
Jul 16 21:37:30.854235 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-df574ed5-be59-4511-b41c-4f10be2324fd tempest-VolumesSnapshotListTestJSON-2020005183 None] Lock "cinder-2982de59-7d9e-41db-bf2f-0aa95ea44aa1-delete_volume" released by "delete_volume" :: held 8.373s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:37:31.279280 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-1ee1a6d6-3107-4a20-8a78-34bcbc88d865 req-1bf7dd28-4a85-46bd-8663-e69c84413331 tempest-AttachVolumeNegativeTest-17004004 None] Terminate volume connection completed successfully.
Jul 16 21:37:31.279700 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-1ee1a6d6-3107-4a20-8a78-34bcbc88d865 req-1bf7dd28-4a85-46bd-8663-e69c84413331 tempest-AttachVolumeNegativeTest-17004004 None] Deleting attachment d6ea954e-7ffe-414c-b894-a6513c1244bd. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:37:36.782070 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:37:36.782802 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:37:36.871497 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:37:37.004017 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:37:37.872767 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-60d3e0bc-4a90-4e56-abf6-19f06ed13bd7 tempest-VolumesBackupsAdminTest-2094650034 None] Acquiring lock "cinder-2c28ee7a-347e-40bb-8de5-7dbd8c649be1-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:37:37.887400 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-60d3e0bc-4a90-4e56-abf6-19f06ed13bd7 tempest-VolumesBackupsAdminTest-2094650034 None] Lock "cinder-2c28ee7a-347e-40bb-8de5-7dbd8c649be1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:37:37.892549 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=55,cinder:INSERT=8,cinder:UPDATE=28,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:37:38.065980 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-60d3e0bc-4a90-4e56-abf6-19f06ed13bd7 tempest-VolumesBackupsAdminTest-2094650034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:37:41.844331 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-60d3e0bc-4a90-4e56-abf6-19f06ed13bd7 tempest-VolumesBackupsAdminTest-2094650034 None] Volume volume-2c28ee7a-347e-40bb-8de5-7dbd8c649be1 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:37:42.811352 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-60d3e0bc-4a90-4e56-abf6-19f06ed13bd7 tempest-VolumesBackupsAdminTest-2094650034 None] deleting rbd volume volume-2c28ee7a-347e-40bb-8de5-7dbd8c649be1 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:37:51.785099 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-60d3e0bc-4a90-4e56-abf6-19f06ed13bd7 tempest-VolumesBackupsAdminTest-2094650034 None] Created reservations ['8d81dff2-8692-4c28-bdef-ba8e6feaa59c', '9b4fa45a-2b78-401b-a5b8-d13b89f8a18e', '4e8b7052-dd7d-4ff6-9ebc-20900607875a', 'e10bf26b-8259-4752-b61e-2477b1e7fd61'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:37:52.142658 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-60d3e0bc-4a90-4e56-abf6-19f06ed13bd7 tempest-VolumesBackupsAdminTest-2094650034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:37:52.315700 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-60d3e0bc-4a90-4e56-abf6-19f06ed13bd7 tempest-VolumesBackupsAdminTest-2094650034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:37:52.386431 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-60d3e0bc-4a90-4e56-abf6-19f06ed13bd7 tempest-VolumesBackupsAdminTest-2094650034 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:37:52.392140 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-60d3e0bc-4a90-4e56-abf6-19f06ed13bd7 tempest-VolumesBackupsAdminTest-2094650034 None] Deleted volume successfully.
Jul 16 21:37:52.489480 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-60d3e0bc-4a90-4e56-abf6-19f06ed13bd7 tempest-VolumesBackupsAdminTest-2094650034 None] Lock "cinder-2c28ee7a-347e-40bb-8de5-7dbd8c649be1-delete_volume" released by "delete_volume" :: held 14.602s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:37:53.221479 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-c24329f9-b9a5-4df1-9290-e7ac370cb689 tempest-VolumesBackupsAdminTest-2094650034 None] Acquiring lock "cinder-77db5a1b-4fec-4112-88ee-174b21741afe-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:37:53.246903 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-c24329f9-b9a5-4df1-9290-e7ac370cb689 tempest-VolumesBackupsAdminTest-2094650034 None] Lock "cinder-77db5a1b-4fec-4112-88ee-174b21741afe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:37:53.404034 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c24329f9-b9a5-4df1-9290-e7ac370cb689 tempest-VolumesBackupsAdminTest-2094650034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:37:56.606595 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c24329f9-b9a5-4df1-9290-e7ac370cb689 tempest-VolumesBackupsAdminTest-2094650034 None] Volume volume-77db5a1b-4fec-4112-88ee-174b21741afe is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:37:57.746976 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c24329f9-b9a5-4df1-9290-e7ac370cb689 tempest-VolumesBackupsAdminTest-2094650034 None] deleting rbd volume volume-77db5a1b-4fec-4112-88ee-174b21741afe {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:37:59.347399 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] Terminate volume connection completed successfully.
Jul 16 21:37:59.372012 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] Remove volume export completed successfully.
Jul 16 21:37:59.408782 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-9496212f-0db2-4ff7-85ef-4f825a75c1d9-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:37:59.419901 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-9496212f-0db2-4ff7-85ef-4f825a75c1d9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:37:59.436265 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:37:59.692592 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:37:59.881087 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] deleting rbd volume volume-9496212f-0db2-4ff7-85ef-4f825a75c1d9 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:38:03.416512 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=37,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:38:03.610349 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-c24329f9-b9a5-4df1-9290-e7ac370cb689 tempest-VolumesBackupsAdminTest-2094650034 None] Created reservations ['ed2504ab-fd3e-4ec2-a93d-9f08dc1e30c2', 'a7de8d63-ad70-4ef6-8d84-8476cfd03530', 'ba8827c3-eac0-4f2f-a13a-fcbb2bea943b', 'aeef350e-3273-4f5d-b955-0818040dbfe4'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:38:03.844804 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c24329f9-b9a5-4df1-9290-e7ac370cb689 tempest-VolumesBackupsAdminTest-2094650034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:03.906675 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c24329f9-b9a5-4df1-9290-e7ac370cb689 tempest-VolumesBackupsAdminTest-2094650034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:03.982315 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-c24329f9-b9a5-4df1-9290-e7ac370cb689 tempest-VolumesBackupsAdminTest-2094650034 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:38:03.989007 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-c24329f9-b9a5-4df1-9290-e7ac370cb689 tempest-VolumesBackupsAdminTest-2094650034 None] Deleted volume successfully.
Jul 16 21:38:04.141462 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-c24329f9-b9a5-4df1-9290-e7ac370cb689 tempest-VolumesBackupsAdminTest-2094650034 None] Lock "cinder-77db5a1b-4fec-4112-88ee-174b21741afe-delete_volume" released by "delete_volume" :: held 10.895s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:38:06.250170 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] Deleted volume successfully.
Jul 16 21:38:06.256662 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-71af1dc8-72bf-4ba2-9527-c0bb51905048 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-9496212f-0db2-4ff7-85ef-4f825a75c1d9-delete_volume" released by "delete_volume" :: held 6.837s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:38:13.698425 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=33,cinder:INSERT=8,cinder:UPDATE=26,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:38:13.823264 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:38:13.870803 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Flow 'volume_create_manager' (db6b4d02-8bd0-4f69-9eb7-d426837e23bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:38:13.887727 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3d7950-3c4f-4a93-b85b-6a6f74aabf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:13.929977 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3d7950-3c4f-4a93-b85b-6a6f74aabf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1199536327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0d1172b6-f804-4225-8441-62a40d7b9c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b43e48813b74d35901f0e017dda6dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:38:14Z,use_quota=True,user_id='2fd88df1ee1e4c8eb30675f496cf92ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:13.947683 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db8256c-ae6c-4306-8ca1-5ba31aba7d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:13.959571 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db8256c-ae6c-4306-8ca1-5ba31aba7d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:13.975192 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e2bba5-2a81-47cd-be9d-d104a876ee93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:13.980769 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e2bba5-2a81-47cd-be9d-d104a876ee93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d1172b6-f804-4225-8441-62a40d7b9c31', 'volume_name': 'volume-0d1172b6-f804-4225-8441-62a40d7b9c31', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:13.995783 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908a29c3-efc8-4b26-8bd2-987d1b65fa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:14.002335 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908a29c3-efc8-4b26-8bd2-987d1b65fa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:14.030178 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046b2f44-fb36-4db8-9e49-7085173aac48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:14.033771 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Volume 0d1172b6-f804-4225-8441-62a40d7b9c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d1172b6-f804-4225-8441-62a40d7b9c31', 'volume_size': 1}
Jul 16 21:38:14.036528 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] creating volume 'volume-0d1172b6-f804-4225-8441-62a40d7b9c31' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:38:14.037564 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:15.003046 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:38:15.004202 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:38:15.014804 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046b2f44-fb36-4db8-9e49-7085173aac48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d1172b6-f804-4225-8441-62a40d7b9c31', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:15.024636 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d70775b-3eb4-4f15-ac93-49e4706e94c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:15.183567 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Volume volume-0d1172b6-f804-4225-8441-62a40d7b9c31 (0d1172b6-f804-4225-8441-62a40d7b9c31): created successfully
Jul 16 21:38:15.188033 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d70775b-3eb4-4f15-ac93-49e4706e94c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:15.197258 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Flow 'volume_create_manager' (db6b4d02-8bd0-4f69-9eb7-d426837e23bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:38:15.318366 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-3eab6576-8a46-47f3-ad19-96c3eb6c1a07 tempest-VolumesDeleteCascade-1899898506 None] Created volume successfully.
Jul 16 21:38:16.488275 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-49fcf3a8-eaad-4958-b33a-5611bdc2f3e4 tempest-VolumesDeleteCascade-1899898506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:18.935810 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-49fcf3a8-eaad-4958-b33a-5611bdc2f3e4 tempest-VolumesDeleteCascade-1899898506 None] Create snapshot completed successfully
Jul 16 21:38:20.156905 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3772741a-5b93-4cee-9208-171907859ae9 tempest-VolumesDeleteCascade-1899898506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:22.650405 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-3772741a-5b93-4cee-9208-171907859ae9 tempest-VolumesDeleteCascade-1899898506 None] Create snapshot completed successfully
Jul 16 21:38:23.502098 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Acquiring lock "cinder-0d1172b6-f804-4225-8441-62a40d7b9c31-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:38:23.514596 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Lock "cinder-0d1172b6-f804-4225-8441-62a40d7b9c31-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:38:23.674867 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Performing cascade delete. {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/manager.py:968}}
Jul 16 21:38:23.688995 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Acquiring lock "cinder-1b2ddfca-8c36-4c8c-a393-f7a20df76238-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:38:23.699551 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Lock "cinder-1b2ddfca-8c36-4c8c-a393-f7a20df76238-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:38:23.717613 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:26.696508 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Created reservations ['a89fcb5e-ac36-4ca8-94fb-10aa9f0fe06b', '206b9ab2-65e3-4b53-a85d-3fad5577fc5e', '5715192f-6bf7-4952-a415-83d08330f57c', '7176a4a6-2a5c-4743-b71a-09f06cbe19d9'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:38:27.078085 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Delete snapshot completed successfully.
Jul 16 21:38:27.078085 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Lock "cinder-1b2ddfca-8c36-4c8c-a393-f7a20df76238-delete_snapshot" released by "delete_snapshot" :: held 3.379s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:38:27.078978 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Acquiring lock "cinder-a3bb2eb6-d22d-4d28-9125-89019e241f7c-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:38:27.089529 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Lock "cinder-a3bb2eb6-d22d-4d28-9125-89019e241f7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:38:27.115069 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:30.182236 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Created reservations ['ec8822b9-0776-4899-831d-baae921e4b04', '25f1f27a-abb6-4931-ba77-0707b3bbd0fd', '74b16957-9944-4fd2-8f46-da45983ba8da', 'cbb1aeab-4beb-4731-9805-3da8a441e9bb'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:38:30.499285 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Delete snapshot completed successfully.
Jul 16 21:38:30.502381 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Lock "cinder-a3bb2eb6-d22d-4d28-9125-89019e241f7c-delete_snapshot" released by "delete_snapshot" :: held 3.413s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:38:30.503229 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Snapshots deleted, issuing volume delete {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/manager.py:983}}
Jul 16 21:38:30.504506 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:30.821390 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:38:30.827254 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Volume volume-0d1172b6-f804-4225-8441-62a40d7b9c31 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:38:31.067306 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] deleting rbd volume volume-0d1172b6-f804-4225-8441-62a40d7b9c31 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:38:32.406774 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:38:32.455880 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Flow 'volume_create_manager' (0db561a3-4b34-44c0-8696-e29b408dc052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:38:32.464487 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a56de95-51a3-4cb5-9693-9642c3563d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:32.491731 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a56de95-51a3-4cb5-9693-9642c3563d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-171268947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=cf391899-1c79-49a5-8aea-2e9463b0c6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56b8099d9406431284b4dd58b5c16359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:38:32Z,use_quota=True,user_id='95cd6b54d8164de1a524b407a1852ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:32.498219 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31cb55aa-4a1b-4626-ad33-19f7fda4809f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:32.514745 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31cb55aa-4a1b-4626-ad33-19f7fda4809f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:32.530965 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9422c130-73de-43fa-9c62-e1741c0edba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:32.668681 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9422c130-73de-43fa-9c62-e1741c0edba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf391899-1c79-49a5-8aea-2e9463b0c6f8', 'volume_name': 'volume-cf391899-1c79-49a5-8aea-2e9463b0c6f8', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9591a287f0>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:32.674063 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389000b0-2b17-4a55-8000-675543842eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:32.688534 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389000b0-2b17-4a55-8000-675543842eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:32.708763 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38d40d8-9c8e-4847-b66f-48ca48c2f049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:32.728422 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume cf391899-1c79-49a5-8aea-2e9463b0c6f8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf391899-1c79-49a5-8aea-2e9463b0c6f8', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9591a287f0>}
Jul 16 21:38:32.729020 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Cloning cf391899-1c79-49a5-8aea-2e9463b0c6f8 from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9  at location (None, None). {{(pid=131857) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Jul 16 21:38:32.735174 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" by "_prepare_image_cache_entry" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:38:32.762470 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" acquired by "_prepare_image_cache_entry" :: waited 0.033s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:38:32.907785 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 38, 32, 783578)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:38:32.908228 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:38:32.908666 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Found cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Jul 16 21:38:32.913901 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" released by "_prepare_image_cache_entry" :: held 0.151s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:38:32.917955 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Attempting to retrieve cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Jul 16 21:38:32.938685 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 38, 32, 923554)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:38:32.946693 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:38:32.946693 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Creating from source image-volume b59b3901-b32a-4d92-81b0-6b99e88e4517 {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Jul 16 21:38:32.986012 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:33.462167 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] creating snapshot='volume-cf391899-1c79-49a5-8aea-2e9463b0c6f8.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:38:35.835368 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] cloning 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517@volume-cf391899-1c79-49a5-8aea-2e9463b0c6f8.clone_snap' to 'volume-cf391899-1c79-49a5-8aea-2e9463b0c6f8' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:38:36.780009 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:38:36.781057 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:36.848655 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:36.971253 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:38:37.652435 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=21,cinder:SELECT=49,cinder:DELETE=1,cinder:INSERT=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:38:37.749813 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945.deleted is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:38:37.755041 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:38:37.755041 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:38:38.516795 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:38:38.517485 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Marking volume cf391899-1c79-49a5-8aea-2e9463b0c6f8 as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:38:38.523671 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Created reservations ['7c51d89d-d90b-4092-ac69-32bc362864b7', '4d5612e4-9f3f-4023-95d4-ad5d54239d32', '8c147781-3894-48c1-b5c4-7bd5c9b0c2d6', '811a5c12-a2cf-45d7-919c-89aa597f7844'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:38:38.622591 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Copying metadata from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 to cf391899-1c79-49a5-8aea-2e9463b0c6f8. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Jul 16 21:38:38.623645 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Creating volume glance metadata for volume cf391899-1c79-49a5-8aea-2e9463b0c6f8 backed by image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131857) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Jul 16 21:38:38.642373 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=64,cinder:UPDATE=24,cinder:DELETE=2,cinder:INSERT=10 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:38:38.786734 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:38.852161 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:38.936621 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:38:38.942284 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38d40d8-9c8e-4847-b66f-48ca48c2f049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf391899-1c79-49a5-8aea-2e9463b0c6f8', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9591a287f0>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:38.955659 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e956a9fa-188a-44cf-aec7-73cf37d4983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:38.976108 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Deleted volume successfully.
Jul 16 21:38:39.075185 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume volume-cf391899-1c79-49a5-8aea-2e9463b0c6f8 (cf391899-1c79-49a5-8aea-2e9463b0c6f8): created successfully
Jul 16 21:38:39.079646 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e956a9fa-188a-44cf-aec7-73cf37d4983b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:39.085565 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Flow 'volume_create_manager' (0db561a3-4b34-44c0-8696-e29b408dc052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:38:39.116928 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a7f2797d-21a5-4036-b64e-3c0d83b47edd tempest-VolumesDeleteCascade-1899898506 None] Lock "cinder-0d1172b6-f804-4225-8441-62a40d7b9c31-delete_volume" released by "delete_volume" :: held 15.602s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:38:39.187470 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-5fce2867-8563-468b-9dca-213855774c92 tempest-VolumesSnapshotTestJSON-1954720325 None] Created volume successfully.
Jul 16 21:38:40.817550 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-08dd3459-00a7-4c63-9f39-cf855bebfd33 req-56ca18a2-7bd1-42a8-9841-e0ac3e1b2046 tempest-VolumesSnapshotTestJSON-1954720325 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:38:42.150946 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-08dd3459-00a7-4c63-9f39-cf855bebfd33 req-56ca18a2-7bd1-42a8-9841-e0ac3e1b2046 tempest-VolumesSnapshotTestJSON-1954720325 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.333s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:38:42.152743 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-08dd3459-00a7-4c63-9f39-cf855bebfd33 req-56ca18a2-7bd1-42a8-9841-e0ac3e1b2046 tempest-VolumesSnapshotTestJSON-1954720325 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cf391899-1c79-49a5-8aea-2e9463b0c6f8', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'cf391899-1c79-49a5-8aea-2e9463b0c6f8', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:38:42.289607 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-08dd3459-00a7-4c63-9f39-cf855bebfd33 req-56ca18a2-7bd1-42a8-9841-e0ac3e1b2046 tempest-VolumesSnapshotTestJSON-1954720325 None] Connection info returned from driver {'name': 'volumes/volume-cf391899-1c79-49a5-8aea-2e9463b0c6f8', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cf391899-1c79-49a5-8aea-2e9463b0c6f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7fd9a858-fc39-4a85-ac4e-e94af710e2f9'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:38:42.451777 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-08dd3459-00a7-4c63-9f39-cf855bebfd33 req-56ca18a2-7bd1-42a8-9841-e0ac3e1b2046 tempest-VolumesSnapshotTestJSON-1954720325 None] attachment_update completed successfully.
Jul 16 21:38:44.720110 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:38:44.742214 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Flow 'volume_create_manager' (ab47f79f-8845-48e9-9f8b-d456275006cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:38:44.748939 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0237967a-b6a7-4af3-a421-196a4f4bbc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:44.767390 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0237967a-b6a7-4af3-a421-196a4f4bbc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-673764289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9e05522f-0815-45ac-874d-29786c1984f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a65db22ff1e4f57ad5fe34fb25c6c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:38:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:38:44Z,use_quota=True,user_id='96313adfa10d47138aefbcd37b5b498d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:44.773965 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fea335-ea86-489c-816a-91372506e75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:44.778316 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fea335-ea86-489c-816a-91372506e75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:44.783412 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2057a99-3a34-4f8c-ab5c-93f2dfd9f0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:44.787437 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2057a99-3a34-4f8c-ab5c-93f2dfd9f0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e05522f-0815-45ac-874d-29786c1984f6', 'volume_name': 'volume-9e05522f-0815-45ac-874d-29786c1984f6', 'volume_size': 2}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:44.792331 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3add40ce-0202-4a2d-a104-11a1171fd8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:44.796235 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3add40ce-0202-4a2d-a104-11a1171fd8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:44.800831 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bf6ece-e399-4a01-ac09-02556a8611d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:44.801919 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Volume 9e05522f-0815-45ac-874d-29786c1984f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e05522f-0815-45ac-874d-29786c1984f6', 'volume_size': 2}
Jul 16 21:38:44.802329 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] creating volume 'volume-9e05522f-0815-45ac-874d-29786c1984f6' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:38:44.803318 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:44.973111 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:38:44.997269 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Flow 'volume_create_manager' (9dc12d5e-7aec-4fcd-a19e-bda219f27d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:38:45.006724 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef2e63b-eeb3-49ca-9fff-8a6b4763d259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:45.026259 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef2e63b-eeb3-49ca-9fff-8a6b4763d259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-479919349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0e8d79ef-dae3-4fef-bd30-da0b85b52de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60c0863dc6f4313bdc873fda27ae2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:38:45Z,use_quota=True,user_id='0ab8b3f06e994bbca5d6dd14109bfe50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:45.032085 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead9d706-b1b0-493d-a085-b36a7e485488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:45.036668 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead9d706-b1b0-493d-a085-b36a7e485488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:45.043397 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b736a63-6adf-4e41-a42f-e3bccb3bd6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:45.047821 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b736a63-6adf-4e41-a42f-e3bccb3bd6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e8d79ef-dae3-4fef-bd30-da0b85b52de1', 'volume_name': 'volume-0e8d79ef-dae3-4fef-bd30-da0b85b52de1', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:45.053299 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a782a45b-bffa-42e1-85b4-3448a9d942e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:45.058080 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a782a45b-bffa-42e1-85b4-3448a9d942e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:45.063366 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dafcf171-64f3-49b3-893e-0140a74b10e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:45.064861 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Volume 0e8d79ef-dae3-4fef-bd30-da0b85b52de1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e8d79ef-dae3-4fef-bd30-da0b85b52de1', 'volume_size': 1}
Jul 16 21:38:45.065465 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] creating volume 'volume-0e8d79ef-dae3-4fef-bd30-da0b85b52de1' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:38:45.066329 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:45.840402 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:38:45.860548 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Flow 'volume_create_manager' (2981935d-8302-444f-8589-9e741daaea40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:38:45.867746 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7daef2b-71d1-4f05-81dd-a9caaf4a0ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:45.885322 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7daef2b-71d1-4f05-81dd-a9caaf4a0ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1338469131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=08629f8b-2fa4-47c6-a3f4-f26714ae06dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b533f85aeddf4d8db05f2c53a61befc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:38:46Z,use_quota=True,user_id='62209b9802ab46c3b3d094d4d1ad86fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:45.890662 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0171e338-e5ff-40e7-ae08-cfde7874fd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:45.896114 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0171e338-e5ff-40e7-ae08-cfde7874fd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:45.902206 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59050403-01bc-4c13-8400-df735214dd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:45.917862 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:38:45.918610 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:38:45.946110 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bf6ece-e399-4a01-ac09-02556a8611d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e05522f-0815-45ac-874d-29786c1984f6', 'volume_size': 2}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:45.961016 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7190f013-e4ce-4746-abbf-d286f301d547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:46.041136 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59050403-01bc-4c13-8400-df735214dd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '08629f8b-2fa4-47c6-a3f4-f26714ae06dc', 'volume_name': 'volume-08629f8b-2fa4-47c6-a3f4-f26714ae06dc', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958ef6aa30>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:46.046566 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27b310a-7d54-46ba-8511-5e0d6369304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:46.051459 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27b310a-7d54-46ba-8511-5e0d6369304b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:46.057817 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ab9590-0815-4ef6-b3c1-2b44056fa16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:46.059228 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Volume 08629f8b-2fa4-47c6-a3f4-f26714ae06dc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-08629f8b-2fa4-47c6-a3f4-f26714ae06dc', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958ef6aa30>}
Jul 16 21:38:46.060016 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Cloning 08629f8b-2fa4-47c6-a3f4-f26714ae06dc from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9  at location (None, None). {{(pid=131857) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Jul 16 21:38:46.061220 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Acquiring lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" by "_prepare_image_cache_entry" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:38:46.065651 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Volume volume-9e05522f-0815-45ac-874d-29786c1984f6 (9e05522f-0815-45ac-874d-29786c1984f6): created successfully
Jul 16 21:38:46.073218 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7190f013-e4ce-4746-abbf-d286f301d547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:46.078842 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Flow 'volume_create_manager' (ab47f79f-8845-48e9-9f8b-d456275006cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:38:46.091818 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" acquired by "_prepare_image_cache_entry" :: waited 0.031s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:38:46.151490 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:38:46.151944 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:38:46.155875 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dafcf171-64f3-49b3-893e-0140a74b10e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e8d79ef-dae3-4fef-bd30-da0b85b52de1', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:46.166501 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4d3dd0-67e3-4a4c-ac9d-c867a5504be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:46.215463 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-5d1b8d14-2266-4cbb-aa4d-86603b2c086d tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Created volume successfully.
Jul 16 21:38:46.261534 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 38, 46, 98070)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:38:46.262052 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:38:46.262662 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Found cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Jul 16 21:38:46.278478 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" released by "_prepare_image_cache_entry" :: held 0.186s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:38:46.279564 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Attempting to retrieve cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Jul 16 21:38:46.291854 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 38, 46, 286172)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:38:46.292216 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:38:46.292607 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Creating from source image-volume b59b3901-b32a-4d92-81b0-6b99e88e4517 {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Jul 16 21:38:46.295354 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c2c250de-a919-4bec-89cc-fcb05f052750 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:46.662635 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Volume volume-0e8d79ef-dae3-4fef-bd30-da0b85b52de1 (0e8d79ef-dae3-4fef-bd30-da0b85b52de1): created successfully
Jul 16 21:38:46.667667 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4d3dd0-67e3-4a4c-ac9d-c867a5504be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:46.673338 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Flow 'volume_create_manager' (9dc12d5e-7aec-4fcd-a19e-bda219f27d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:38:46.683218 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:46.901055 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] creating snapshot='volume-08629f8b-2fa4-47c6-a3f4-f26714ae06dc.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:38:49.250480 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] cloning 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517@volume-08629f8b-2fa4-47c6-a3f4-f26714ae06dc.clone_snap' to 'volume-08629f8b-2fa4-47c6-a3f4-f26714ae06dc' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:38:49.269581 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6704975f-98ae-457b-85ac-91c89cd76c0e tempest-BackendsCapabilitiesAdminTestsJSON-1003962279 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:9fe12b71-14ff-4664-9b56-00a25cd04b5b:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=131857) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4736}}
Jul 16 21:38:49.307278 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0d38b75c-2e2b-43bb-9b55-f9ceb8db39d8 tempest-BackendsCapabilitiesAdminTestsJSON-1003962279 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:9fe12b71-14ff-4664-9b56-00a25cd04b5b:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=131857) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4736}}
Jul 16 21:38:49.330269 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-9c6c4363-83cd-47b5-b2d5-6e04fe676640 tempest-AttachVolumeNegativeTest-17004004 None] Created volume successfully.
Jul 16 21:38:49.354125 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-af57f381-0f72-40de-8737-d29eb6fb0c68 tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:50.192730 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-c2c250de-a919-4bec-89cc-fcb05f052750 tempest-VolumesSnapshotTestJSON-1954720325 None] Create snapshot completed successfully
Jul 16 21:38:51.100000 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945.deleted is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:38:51.101372 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:38:51.101746 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:38:51.911795 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:38:51.912530 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Marking volume 08629f8b-2fa4-47c6-a3f4-f26714ae06dc as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:38:52.026978 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Copying metadata from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 to 08629f8b-2fa4-47c6-a3f4-f26714ae06dc. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Jul 16 21:38:52.027424 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Creating volume glance metadata for volume 08629f8b-2fa4-47c6-a3f4-f26714ae06dc backed by image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131857) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Jul 16 21:38:52.029278 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:INSERT=15,cinder:SELECT=62,cinder:UPDATE=19,cinder:DELETE=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:38:52.083183 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1d57eaae-9861-4c54-b862-77d351f3cd7f tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:52.510546 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ab9590-0815-4ef6-b3c1-2b44056fa16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08629f8b-2fa4-47c6-a3f4-f26714ae06dc', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958ef6aa30>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:52.515219 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429fa6f1-e884-4765-b504-8d84e110cb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:38:52.661181 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Volume volume-08629f8b-2fa4-47c6-a3f4-f26714ae06dc (08629f8b-2fa4-47c6-a3f4-f26714ae06dc): created successfully
Jul 16 21:38:52.665716 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429fa6f1-e884-4765-b504-8d84e110cb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:38:52.670557 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Flow 'volume_create_manager' (2981935d-8302-444f-8589-9e741daaea40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:38:52.752585 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-77ce4ce5-29e4-4a1d-a9f8-224e967f630f tempest-TestVolumeBootPattern-1625426921 None] Created volume successfully.
Jul 16 21:38:53.169843 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-af57f381-0f72-40de-8737-d29eb6fb0c68 tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Create snapshot completed successfully
Jul 16 21:38:53.639185 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bd6244f9-eb83-4b68-9f4d-ff9351755894 tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:53.951396 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-cca74d44-b845-4823-ac65-460c73ab0732 tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Acquiring lock "cinder-1a399858-e754-47e0-a3c7-42bbbb86437b-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:38:53.963966 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-cca74d44-b845-4823-ac65-460c73ab0732 tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Lock "cinder-1a399858-e754-47e0-a3c7-42bbbb86437b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:38:53.965380 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cca74d44-b845-4823-ac65-460c73ab0732 tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:55.297559 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=65,cinder:UPDATE=14,cinder:INSERT=18,cinder:DELETE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:38:55.518190 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-1d57eaae-9861-4c54-b862-77d351f3cd7f tempest-VolumesSnapshotTestJSON-1954720325 None] Create snapshot completed successfully
Jul 16 21:38:56.887110 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f3b7dc52-6a22-487c-83e0-41a965dbe57a tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:57.093115 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-bd6244f9-eb83-4b68-9f4d-ff9351755894 tempest-TestVolumeBootPattern-1625426921 None] Create snapshot completed successfully
Jul 16 21:38:57.998608 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-cca74d44-b845-4823-ac65-460c73ab0732 tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Created reservations ['f49c8d91-9868-40bf-b560-1e1aac867be4', 'aff39579-2e5b-4990-8d23-4af797f34fd0', '7f19281b-188c-4abb-afe3-a6fc9717bc9b', '321c6ac2-76f5-4a34-bb60-d81182d35fa9'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:38:58.181061 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-cca74d44-b845-4823-ac65-460c73ab0732 tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Delete snapshot completed successfully.
Jul 16 21:38:58.185776 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-cca74d44-b845-4823-ac65-460c73ab0732 tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Lock "cinder-1a399858-e754-47e0-a3c7-42bbbb86437b-delete_snapshot" released by "delete_snapshot" :: held 4.222s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:38:59.104035 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-48e5faea-51af-4a83-bd46-f15df9b6f83b tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Acquiring lock "cinder-9e05522f-0815-45ac-874d-29786c1984f6-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:38:59.122380 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-48e5faea-51af-4a83-bd46-f15df9b6f83b tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Lock "cinder-9e05522f-0815-45ac-874d-29786c1984f6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:38:59.329405 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-48e5faea-51af-4a83-bd46-f15df9b6f83b tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:38:59.598805 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-48e5faea-51af-4a83-bd46-f15df9b6f83b tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:38:59.602685 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-48e5faea-51af-4a83-bd46-f15df9b6f83b tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Volume volume-9e05522f-0815-45ac-874d-29786c1984f6 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:38:59.753229 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-48e5faea-51af-4a83-bd46-f15df9b6f83b tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] deleting rbd volume volume-9e05522f-0815-45ac-874d-29786c1984f6 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:38:59.756121 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f3b7dc52-6a22-487c-83e0-41a965dbe57a tempest-VolumesSnapshotTestJSON-1954720325 None] Create snapshot completed successfully
Jul 16 21:38:59.886668 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3de15eac-14fe-4ce3-8a1e-5e39451e6075 tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-d6692859-f908-4d21-8713-7340fe7f74c7-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:38:59.896548 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3de15eac-14fe-4ce3-8a1e-5e39451e6075 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-d6692859-f908-4d21-8713-7340fe7f74c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:38:59.898143 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3de15eac-14fe-4ce3-8a1e-5e39451e6075 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:00.468318 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-222628ab-3ed9-446e-a1e8-59c459897249 tempest-GroupsTest-1522737571 None] Group tempest-Group1-103267843: creating
Jul 16 21:39:00.632605 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-222628ab-3ed9-446e-a1e8-59c459897249 tempest-GroupsTest-1522737571 None] Group tempest-Group1-103267843: created successfully
Jul 16 21:39:00.644081 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-222628ab-3ed9-446e-a1e8-59c459897249 tempest-GroupsTest-1522737571 None] Create group completed successfully.
Jul 16 21:39:02.083962 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d051ffd4-31bd-4d37-88f2-85e45096d4eb tempest-GroupsTest-1522737571 None] Group tempest-Group2-1596408651: creating
Jul 16 21:39:02.108868 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=53,cinder:INSERT=35,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:39:02.186781 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d051ffd4-31bd-4d37-88f2-85e45096d4eb tempest-GroupsTest-1522737571 None] Group tempest-Group2-1596408651: created successfully
Jul 16 21:39:02.197381 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d051ffd4-31bd-4d37-88f2-85e45096d4eb tempest-GroupsTest-1522737571 None] Create group completed successfully.
Jul 16 21:39:02.405925 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:39:02.434364 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Flow 'volume_create_manager' (20783eb4-1ed9-46ce-a577-4d9f91b97b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:39:02.440627 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf4ce3c-b52a-4698-8e64-d0629e92355b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:02.457727 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf4ce3c-b52a-4698-8e64-d0629e92355b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:39:02Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=72052901-bedc-4bbe-9450-d1f93451a3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b533f85aeddf4d8db05f2c53a61befc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1271e76a-1165-49b4-b725-7079124c1d75,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:39:02Z,use_quota=True,user_id='62209b9802ab46c3b3d094d4d1ad86fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:02.463354 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb52263-5abe-4838-b5e7-39ceb3bf48b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:02.467447 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb52263-5abe-4838-b5e7-39ceb3bf48b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:02.472603 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b25877-5795-4948-bb38-d00931659a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:02.476686 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b25877-5795-4948-bb38-d00931659a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '72052901-bedc-4bbe-9450-d1f93451a3a1', 'volume_name': 'volume-72052901-bedc-4bbe-9450-d1f93451a3a1', 'volume_size': 1, 'snapshot_id': '1271e76a-1165-49b4-b725-7079124c1d75'}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:02.482725 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72975dc5-3aea-4acc-9e37-a9d20fb64e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:02.486505 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72975dc5-3aea-4acc-9e37-a9d20fb64e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:02.491079 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c458d6bd-a1ae-4fb4-842b-58942cd2a091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:02.492108 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Volume 72052901-bedc-4bbe-9450-d1f93451a3a1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-72052901-bedc-4bbe-9450-d1f93451a3a1', 'volume_size': 1, 'snapshot_id': '1271e76a-1165-49b4-b725-7079124c1d75'}
Jul 16 21:39:02.511818 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] cloning volumes/volume-08629f8b-2fa4-47c6-a3f4-f26714ae06dc@snapshot-1271e76a-1165-49b4-b725-7079124c1d75 to volume-72052901-bedc-4bbe-9450-d1f93451a3a1 {{(pid=131857) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}}
Jul 16 21:39:02.512441 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:02.572699 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:04.130976 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:39:04.153198 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Flow 'volume_create_manager' (81023a88-c9ce-4d0b-9db1-375b1d4058a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:39:04.159954 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684d4dd2-f9bb-4052-866d-5f3ffffc6932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:04.178540 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684d4dd2-f9bb-4052-866d-5f3ffffc6932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-653836447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1456dedf-e771-4b13-9e96-00ca2c9b411a,host='ncdv-master-1@ceph#ceph',id=0f537cdf-71e2-4a7a-98fc-08d9b4c8644a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f540a96c981448af977daf185a8ae649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:39:04Z,use_quota=True,user_id='ef7c7dd60bf64735afc148cfced6eecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e7ad3ed-d5b5-43a4-8da2-ac9c39706a60),volume_type_id=2e7ad3ed-d5b5-43a4-8da2-ac9c39706a60)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:04.184667 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c930617-a692-4d97-b525-9179b72b517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:04.188672 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c930617-a692-4d97-b525-9179b72b517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:04.193676 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6214472-2454-461b-a8d1-f28a550cf477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:04.197740 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6214472-2454-461b-a8d1-f28a550cf477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f537cdf-71e2-4a7a-98fc-08d9b4c8644a', 'volume_name': 'volume-0f537cdf-71e2-4a7a-98fc-08d9b4c8644a', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:04.202488 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (623345da-7f51-4cf4-a710-c5ccb74cfc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:04.206277 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (623345da-7f51-4cf4-a710-c5ccb74cfc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:04.210777 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2030d331-5bc4-45dd-a278-d5c9c9b5ea92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:04.211907 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Volume 0f537cdf-71e2-4a7a-98fc-08d9b4c8644a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f537cdf-71e2-4a7a-98fc-08d9b4c8644a', 'volume_size': 1}
Jul 16 21:39:04.216172 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] creating volume 'volume-0f537cdf-71e2-4a7a-98fc-08d9b4c8644a' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:39:04.216172 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:04.460968 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:39:04.461268 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:39:04.477487 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Marking volume 72052901-bedc-4bbe-9450-d1f93451a3a1 as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:39:04.529134 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Copying metadata from snapshot 1271e76a-1165-49b4-b725-7079124c1d75 to 72052901-bedc-4bbe-9450-d1f93451a3a1. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:430}}
Jul 16 21:39:04.623941 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c458d6bd-a1ae-4fb4-842b-58942cd2a091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72052901-bedc-4bbe-9450-d1f93451a3a1', 'volume_size': 1, 'snapshot_id': '1271e76a-1165-49b4-b725-7079124c1d75'}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:04.628459 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3198cf9b-4ff5-44cb-942f-2f6cd3d38041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:04.706722 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Volume volume-72052901-bedc-4bbe-9450-d1f93451a3a1 (72052901-bedc-4bbe-9450-d1f93451a3a1): created successfully
Jul 16 21:39:04.710238 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3198cf9b-4ff5-44cb-942f-2f6cd3d38041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:04.716230 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Flow 'volume_create_manager' (20783eb4-1ed9-46ce-a577-4d9f91b97b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:39:04.780945 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-c9301d40-ed4b-430a-a9fc-48ed42f94a13 tempest-TestVolumeBootPattern-1625426921 None] Created volume successfully.
Jul 16 21:39:05.023928 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] extra_specs: {} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:39:05.024307 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] extra_specs: {} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:39:05.028816 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2030d331-5bc4-45dd-a278-d5c9c9b5ea92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f537cdf-71e2-4a7a-98fc-08d9b4c8644a', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:05.033515 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731b886a-3f5f-4fee-a400-b08402f3ec55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:05.124418 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Volume volume-0f537cdf-71e2-4a7a-98fc-08d9b4c8644a (0f537cdf-71e2-4a7a-98fc-08d9b4c8644a): created successfully
Jul 16 21:39:05.130328 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731b886a-3f5f-4fee-a400-b08402f3ec55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:05.137913 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Flow 'volume_create_manager' (81023a88-c9ce-4d0b-9db1-375b1d4058a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:39:05.261488 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-1e670c5c-c6da-4409-8be9-934d6ebf7178 tempest-GroupsTest-1522737571 None] Created volume successfully.
Jul 16 21:39:05.456672 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-48e5faea-51af-4a83-bd46-f15df9b6f83b tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Created reservations ['f5b79b42-8081-47c3-a5fb-89f58eb5bce6', '61754a76-94a7-46e3-be07-a68654b8ed93', 'bb831761-f2e9-492c-b4e9-a09639c7b151', 'f7e76ff1-7f8c-411b-b1de-8ea323f9d557'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:39:05.592558 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-9e978e8a-e9a4-41e3-84e5-af4a82293394 tempest-TestVolumeBootPattern-1625426921 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:39:05.623392 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-48e5faea-51af-4a83-bd46-f15df9b6f83b tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:05.702490 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-48e5faea-51af-4a83-bd46-f15df9b6f83b tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:05.732682 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-48e5faea-51af-4a83-bd46-f15df9b6f83b tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:39:05.737799 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-48e5faea-51af-4a83-bd46-f15df9b6f83b tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Deleted volume successfully.
Jul 16 21:39:05.826668 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-48e5faea-51af-4a83-bd46-f15df9b6f83b tempest-VolumesSnapshotNegativeTestJSON-2085450128 None] Lock "cinder-9e05522f-0815-45ac-874d-29786c1984f6-delete_volume" released by "delete_volume" :: held 6.704s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:39:06.441298 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-9e978e8a-e9a4-41e3-84e5-af4a82293394 tempest-TestVolumeBootPattern-1625426921 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.849s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:39:06.441969 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-9e978e8a-e9a4-41e3-84e5-af4a82293394 tempest-TestVolumeBootPattern-1625426921 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-72052901-bedc-4bbe-9450-d1f93451a3a1', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '72052901-bedc-4bbe-9450-d1f93451a3a1', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:39:06.540622 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-9e978e8a-e9a4-41e3-84e5-af4a82293394 tempest-TestVolumeBootPattern-1625426921 None] Connection info returned from driver {'name': 'volumes/volume-72052901-bedc-4bbe-9450-d1f93451a3a1', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '72052901-bedc-4bbe-9450-d1f93451a3a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '80c756cb-bcda-45d9-bcc7-8d830794083f'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:39:06.652891 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-329a9f89-7bed-40f7-95f5-87457a7e7941 req-9e978e8a-e9a4-41e3-84e5-af4a82293394 tempest-TestVolumeBootPattern-1625426921 None] attachment_update completed successfully.
Jul 16 21:39:06.691466 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4a73b8aa-eded-4ac9-9005-40b92c331e28 tempest-GroupsTest-1522737571 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:06.801622 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4a73b8aa-eded-4ac9-9005-40b92c331e28 tempest-GroupsTest-1522737571 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:39:06.801881 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4a73b8aa-eded-4ac9-9005-40b92c331e28 tempest-GroupsTest-1522737571 None] Volume volume-0f537cdf-71e2-4a7a-98fc-08d9b4c8644a is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:39:06.936104 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4a73b8aa-eded-4ac9-9005-40b92c331e28 tempest-GroupsTest-1522737571 None] deleting rbd volume volume-0f537cdf-71e2-4a7a-98fc-08d9b4c8644a {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:39:11.830060 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=67,cinder:INSERT=11,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:39:12.148327 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-4a73b8aa-eded-4ac9-9005-40b92c331e28 tempest-GroupsTest-1522737571 None] Created reservations ['a782bdcc-4649-47fe-b004-25edb21cbcac'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:39:12.170224 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-4a73b8aa-eded-4ac9-9005-40b92c331e28 tempest-GroupsTest-1522737571 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1705190312 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1705190312, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:39:12.171136 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-4a73b8aa-eded-4ac9-9005-40b92c331e28 tempest-GroupsTest-1522737571 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1705190312 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1705190312, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:39:12.273307 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-4a73b8aa-eded-4ac9-9005-40b92c331e28 tempest-GroupsTest-1522737571 None] Created reservations ['5699e829-59e7-46f6-96f7-a6ffc394cab8', '1992d54c-d690-401e-bc6f-439183496735', 'db695aec-b15c-4160-9af1-5fea211178a6', '1dda52cb-99a8-4087-a1eb-c6283a6c7b78'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:39:12.638213 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4a73b8aa-eded-4ac9-9005-40b92c331e28 tempest-GroupsTest-1522737571 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:12.665371 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4a73b8aa-eded-4ac9-9005-40b92c331e28 tempest-GroupsTest-1522737571 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:12.699248 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-4a73b8aa-eded-4ac9-9005-40b92c331e28 tempest-GroupsTest-1522737571 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:39:12.704198 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-4a73b8aa-eded-4ac9-9005-40b92c331e28 tempest-GroupsTest-1522737571 None] Delete group completed successfully.
Jul 16 21:39:13.406174 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=59,cinder:UPDATE=25,cinder:INSERT=13,cinder:DELETE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:39:13.524236 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-6dc14b64-53ab-4e59-b1cf-4bd866858d00 tempest-GroupsTest-1522737571 None] Created reservations ['6b850f3a-a0e8-4dd0-910c-e711aae2794c'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:39:13.756668 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6dc14b64-53ab-4e59-b1cf-4bd866858d00 tempest-GroupsTest-1522737571 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:13.805209 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6dc14b64-53ab-4e59-b1cf-4bd866858d00 tempest-GroupsTest-1522737571 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:13.843134 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-6dc14b64-53ab-4e59-b1cf-4bd866858d00 tempest-GroupsTest-1522737571 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:39:13.846765 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-6dc14b64-53ab-4e59-b1cf-4bd866858d00 tempest-GroupsTest-1522737571 None] Delete group completed successfully.
Jul 16 21:39:15.446658 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-4faf4f1d-8ffa-4ffe-bcf8-f0aa65aadda0 tempest-GroupsTest-1522737571 None] Group tempest-GroupsTest-Group-772009330: creating
Jul 16 21:39:15.586014 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-4faf4f1d-8ffa-4ffe-bcf8-f0aa65aadda0 tempest-GroupsTest-1522737571 None] Group tempest-GroupsTest-Group-772009330: created successfully
Jul 16 21:39:15.597876 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-4faf4f1d-8ffa-4ffe-bcf8-f0aa65aadda0 tempest-GroupsTest-1522737571 None] Create group completed successfully.
Jul 16 21:39:17.382821 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:39:17.403119 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Flow 'volume_create_manager' (6db61626-5a17-4e26-99cc-e9e411cd11b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:39:17.410268 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea35920-8b61-4eab-9f41-08b57b3a3451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:17.426802 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea35920-8b61-4eab-9f41-08b57b3a3451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1957389895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cd0e76b3-3be0-43c2-8eaf-77a82fbd653b,host='ncdv-master-1@ceph#ceph',id=3046971c-b6fc-4f01-8ced-31e755a07473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f540a96c981448af977daf185a8ae649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:39:17Z,use_quota=True,user_id='ef7c7dd60bf64735afc148cfced6eecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(885acf82-c137-4d44-a2f7-dd0f7b993501),volume_type_id=885acf82-c137-4d44-a2f7-dd0f7b993501)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:17.432303 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764a2bac-fec3-4e6b-b46d-db942574a224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:17.436996 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764a2bac-fec3-4e6b-b46d-db942574a224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:17.441983 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2861833-3925-46bf-854e-ece833c0a9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:17.447091 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2861833-3925-46bf-854e-ece833c0a9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3046971c-b6fc-4f01-8ced-31e755a07473', 'volume_name': 'volume-3046971c-b6fc-4f01-8ced-31e755a07473', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:17.451282 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c1934d-9c8d-4c0c-b775-2143f093bd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:17.455205 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c1934d-9c8d-4c0c-b775-2143f093bd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:17.459803 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2364e98a-a1c4-4633-a9b8-a3218810f7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:17.460927 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Volume 3046971c-b6fc-4f01-8ced-31e755a07473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3046971c-b6fc-4f01-8ced-31e755a07473', 'volume_size': 1}
Jul 16 21:39:17.461343 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] creating volume 'volume-3046971c-b6fc-4f01-8ced-31e755a07473' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:39:17.462088 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:18.041947 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] extra_specs: {} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:39:18.042377 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] extra_specs: {} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:39:18.046857 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2364e98a-a1c4-4633-a9b8-a3218810f7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3046971c-b6fc-4f01-8ced-31e755a07473', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:18.051364 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efad9a31-7c1a-41cb-a8c7-8ad8fb6f5e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:18.134340 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Volume volume-3046971c-b6fc-4f01-8ced-31e755a07473 (3046971c-b6fc-4f01-8ced-31e755a07473): created successfully
Jul 16 21:39:18.138501 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efad9a31-7c1a-41cb-a8c7-8ad8fb6f5e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:18.143838 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Flow 'volume_create_manager' (6db61626-5a17-4e26-99cc-e9e411cd11b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:39:18.249789 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-10d4fd5a-58fe-4764-a4ee-8715b9c75690 tempest-GroupsTest-1522737571 None] Created volume successfully.
Jul 16 21:39:19.090354 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:39:19.112823 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Flow 'volume_create_manager' (65110d6b-8f28-4958-97e7-a74d153a38c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:39:19.118880 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8db81e3-ff1c-4913-b29e-f76246ec9cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:19.135805 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8db81e3-ff1c-4913-b29e-f76246ec9cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-815689115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cd0e76b3-3be0-43c2-8eaf-77a82fbd653b,host='ncdv-master-1@ceph#ceph',id=e5d90680-7e55-48b2-bd55-fd26d423c62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f540a96c981448af977daf185a8ae649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:39:19Z,use_quota=True,user_id='ef7c7dd60bf64735afc148cfced6eecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(885acf82-c137-4d44-a2f7-dd0f7b993501),volume_type_id=885acf82-c137-4d44-a2f7-dd0f7b993501)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:19.141875 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed66ae2-2b9c-48c3-8d93-09a2afea2dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:19.145877 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed66ae2-2b9c-48c3-8d93-09a2afea2dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:19.150822 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c1fe12-654a-4887-81ab-11e9d591423e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:19.155644 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c1fe12-654a-4887-81ab-11e9d591423e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d90680-7e55-48b2-bd55-fd26d423c62a', 'volume_name': 'volume-e5d90680-7e55-48b2-bd55-fd26d423c62a', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:19.160517 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6bda7c-e94e-4490-a15b-6dff8fd1293a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:19.164375 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6bda7c-e94e-4490-a15b-6dff8fd1293a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:19.168933 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a01a69e-0963-49bf-9f0a-26619224202e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:19.170040 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Volume e5d90680-7e55-48b2-bd55-fd26d423c62a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d90680-7e55-48b2-bd55-fd26d423c62a', 'volume_size': 1}
Jul 16 21:39:19.171488 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] creating volume 'volume-e5d90680-7e55-48b2-bd55-fd26d423c62a' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:39:19.171488 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:19.517924 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-a1fd944b-fabe-4725-8327-85662f0357bf req-2c3d1e67-7e65-47ef-8c76-e855267c9f80 tempest-TestVolumeBootPattern-1625426921 None] Terminate volume connection completed successfully.
Jul 16 21:39:19.518338 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-a1fd944b-fabe-4725-8327-85662f0357bf req-2c3d1e67-7e65-47ef-8c76-e855267c9f80 tempest-TestVolumeBootPattern-1625426921 None] Deleting attachment 80c756cb-bcda-45d9-bcc7-8d830794083f. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:39:19.755925 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] extra_specs: {} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:39:19.756298 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] extra_specs: {} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:39:19.760045 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a01a69e-0963-49bf-9f0a-26619224202e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d90680-7e55-48b2-bd55-fd26d423c62a', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:19.773479 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de42b49b-60c9-40c2-b42e-444e2683306f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:19.877947 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Volume volume-e5d90680-7e55-48b2-bd55-fd26d423c62a (e5d90680-7e55-48b2-bd55-fd26d423c62a): created successfully
Jul 16 21:39:19.881531 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de42b49b-60c9-40c2-b42e-444e2683306f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:19.887218 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Flow 'volume_create_manager' (65110d6b-8f28-4958-97e7-a74d153a38c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:39:19.894338 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-a1fd944b-fabe-4725-8327-85662f0357bf req-9593038e-cc38-48b1-9752-7ff9e34e09e6 tempest-TestVolumeBootPattern-1625426921 None] Acquiring lock "cinder-72052901-bedc-4bbe-9450-d1f93451a3a1-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:39:19.911263 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-a1fd944b-fabe-4725-8327-85662f0357bf req-9593038e-cc38-48b1-9752-7ff9e34e09e6 tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-72052901-bedc-4bbe-9450-d1f93451a3a1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:39:19.958152 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-6f40820b-b9e3-4cc3-a420-a4745a19e4fb tempest-GroupsTest-1522737571 None] Created volume successfully.
Jul 16 21:39:20.032544 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-a1fd944b-fabe-4725-8327-85662f0357bf req-9593038e-cc38-48b1-9752-7ff9e34e09e6 tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:20.311764 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-a1fd944b-fabe-4725-8327-85662f0357bf req-9593038e-cc38-48b1-9752-7ff9e34e09e6 tempest-TestVolumeBootPattern-1625426921 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:39:20.412310 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-a1fd944b-fabe-4725-8327-85662f0357bf req-9593038e-cc38-48b1-9752-7ff9e34e09e6 tempest-TestVolumeBootPattern-1625426921 None] deleting rbd volume volume-72052901-bedc-4bbe-9450-d1f93451a3a1 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:39:20.586058 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-56fb4d29-6007-4f94-9ddb-4cfd14af0ffe tempest-GroupsTest-1522737571 None] Update group completed successfully.
Jul 16 21:39:21.642815 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d05e952c-22cd-493d-8fa5-dd3755ff953f tempest-GroupsTest-1522737571 None] Update group completed successfully.
Jul 16 21:39:23.081748 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-23d71954-abed-4da5-bd6c-f2a4ccb6d52d tempest-GroupsTest-1522737571 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:23.203692 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-23d71954-abed-4da5-bd6c-f2a4ccb6d52d tempest-GroupsTest-1522737571 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:39:23.204152 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-23d71954-abed-4da5-bd6c-f2a4ccb6d52d tempest-GroupsTest-1522737571 None] Volume volume-3046971c-b6fc-4f01-8ced-31e755a07473 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:39:23.318495 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-23d71954-abed-4da5-bd6c-f2a4ccb6d52d tempest-GroupsTest-1522737571 None] deleting rbd volume volume-3046971c-b6fc-4f01-8ced-31e755a07473 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:39:24.940517 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [req-a1fd944b-fabe-4725-8327-85662f0357bf req-9593038e-cc38-48b1-9752-7ff9e34e09e6 tempest-TestVolumeBootPattern-1625426921 None] Created reservations ['9bb3630a-d1b7-47ef-a054-75b0fa7a4b1f', '4a916831-5395-4770-84da-fa92c0e34226', 'c00b8c6b-ac5d-47af-a854-143597a6eb11', 'eb3c641d-1018-4cce-b6c0-553faf148d79'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:39:25.057646 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=67,cinder:INSERT=4,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:39:25.141295 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-a1fd944b-fabe-4725-8327-85662f0357bf req-9593038e-cc38-48b1-9752-7ff9e34e09e6 tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:25.165277 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-a1fd944b-fabe-4725-8327-85662f0357bf req-9593038e-cc38-48b1-9752-7ff9e34e09e6 tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:25.190243 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [req-a1fd944b-fabe-4725-8327-85662f0357bf req-9593038e-cc38-48b1-9752-7ff9e34e09e6 tempest-TestVolumeBootPattern-1625426921 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:39:25.195429 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-a1fd944b-fabe-4725-8327-85662f0357bf req-9593038e-cc38-48b1-9752-7ff9e34e09e6 tempest-TestVolumeBootPattern-1625426921 None] Deleted volume successfully.
Jul 16 21:39:25.244640 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-a1fd944b-fabe-4725-8327-85662f0357bf req-9593038e-cc38-48b1-9752-7ff9e34e09e6 tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-72052901-bedc-4bbe-9450-d1f93451a3a1-delete_volume" released by "delete_volume" :: held 5.331s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:39:26.251574 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-97eae7cb-72f1-4f8a-8ae4-9f7cee2e51ac tempest-TestVolumeBootPattern-1625426921 None] Acquiring lock "cinder-1271e76a-1165-49b4-b725-7079124c1d75-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:39:26.261088 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-97eae7cb-72f1-4f8a-8ae4-9f7cee2e51ac tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-1271e76a-1165-49b4-b725-7079124c1d75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:39:26.262614 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-97eae7cb-72f1-4f8a-8ae4-9f7cee2e51ac tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:27.983755 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-23d71954-abed-4da5-bd6c-f2a4ccb6d52d tempest-GroupsTest-1522737571 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:28.318784 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-23d71954-abed-4da5-bd6c-f2a4ccb6d52d tempest-GroupsTest-1522737571 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:39:28.319240 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-23d71954-abed-4da5-bd6c-f2a4ccb6d52d tempest-GroupsTest-1522737571 None] Volume volume-e5d90680-7e55-48b2-bd55-fd26d423c62a is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:39:28.500944 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-23d71954-abed-4da5-bd6c-f2a4ccb6d52d tempest-GroupsTest-1522737571 None] deleting rbd volume volume-e5d90680-7e55-48b2-bd55-fd26d423c62a {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:39:29.032475 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-97eae7cb-72f1-4f8a-8ae4-9f7cee2e51ac tempest-TestVolumeBootPattern-1625426921 None] Created reservations ['67610de5-10c2-42c6-b3f8-230269eba74b', '9236d741-1b83-48c0-bc31-74bd7dab3803', '4ee3ad95-952d-4586-93cb-d30d0a49c53d', 'f386fa70-ee29-4c17-92b7-0876d3fc553b'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:39:29.346596 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-97eae7cb-72f1-4f8a-8ae4-9f7cee2e51ac tempest-TestVolumeBootPattern-1625426921 None] Delete snapshot completed successfully.
Jul 16 21:39:29.351058 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-97eae7cb-72f1-4f8a-8ae4-9f7cee2e51ac tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-1271e76a-1165-49b4-b725-7079124c1d75-delete_snapshot" released by "delete_snapshot" :: held 3.090s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:39:29.559506 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f31a35e8-94b9-4042-9163-fdd02dd9a652 tempest-TestVolumeBootPattern-1625426921 None] Acquiring lock "cinder-08629f8b-2fa4-47c6-a3f4-f26714ae06dc-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:39:29.569014 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f31a35e8-94b9-4042-9163-fdd02dd9a652 tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-08629f8b-2fa4-47c6-a3f4-f26714ae06dc-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:39:29.672992 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f31a35e8-94b9-4042-9163-fdd02dd9a652 tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:29.867748 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f31a35e8-94b9-4042-9163-fdd02dd9a652 tempest-TestVolumeBootPattern-1625426921 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:39:30.052423 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f31a35e8-94b9-4042-9163-fdd02dd9a652 tempest-TestVolumeBootPattern-1625426921 None] deleting rbd volume volume-08629f8b-2fa4-47c6-a3f4-f26714ae06dc {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:39:31.118586 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-3de15eac-14fe-4ce3-8a1e-5e39451e6075 tempest-VolumesSnapshotTestJSON-1954720325 None] Created reservations ['1f89599c-4b4b-40d3-85aa-38924e943ffa', '83f93f46-f6f2-4d8e-bd3a-7901023158a2', '32a11601-2e49-470a-9ca6-973408d6c6fa', '9a9fd0de-1776-45c2-9c49-deb4ee6b89d9'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:39:31.323866 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=63,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=7 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:39:31.455203 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-3de15eac-14fe-4ce3-8a1e-5e39451e6075 tempest-VolumesSnapshotTestJSON-1954720325 None] Delete snapshot completed successfully.
Jul 16 21:39:31.461363 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3de15eac-14fe-4ce3-8a1e-5e39451e6075 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-d6692859-f908-4d21-8713-7340fe7f74c7-delete_snapshot" released by "delete_snapshot" :: held 31.564s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:39:32.094429 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5da33d32-efea-4175-97da-1ed743f867b9 tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-14479b68-9962-455e-af09-f2bda0ea444a-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:39:32.106833 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5da33d32-efea-4175-97da-1ed743f867b9 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-14479b68-9962-455e-af09-f2bda0ea444a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:39:32.109002 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5da33d32-efea-4175-97da-1ed743f867b9 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:33.729324 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-23d71954-abed-4da5-bd6c-f2a4ccb6d52d tempest-GroupsTest-1522737571 None] Created reservations ['faba2279-eeda-4d04-8d66-5341ddb2b581'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:39:33.751460 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-23d71954-abed-4da5-bd6c-f2a4ccb6d52d tempest-GroupsTest-1522737571 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2136587055 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2136587055, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:39:33.752311 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-23d71954-abed-4da5-bd6c-f2a4ccb6d52d tempest-GroupsTest-1522737571 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2136587055 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2136587055, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:39:33.826742 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-23d71954-abed-4da5-bd6c-f2a4ccb6d52d tempest-GroupsTest-1522737571 None] Created reservations ['9210e211-46e3-4f93-a4de-dbd1a40024cc', 'be721f1c-af78-4800-90b2-4f539e4f8576', '4e024f6f-c808-4dce-9709-e9a0d706fcc2', '0641e95d-53d5-4dc2-aaa0-596e3a89fb8c'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:39:34.163953 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-23d71954-abed-4da5-bd6c-f2a4ccb6d52d tempest-GroupsTest-1522737571 None] Created reservations ['89173b28-4ada-457f-ba2f-d765cb8215f3', '3a319212-dc07-4a95-8773-2ec52f280712', '1c3a53b6-b472-43da-8520-338fc1ecedd7', '63661e22-24f8-433c-9144-89245e6be195'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:39:34.615922 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-23d71954-abed-4da5-bd6c-f2a4ccb6d52d tempest-GroupsTest-1522737571 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:34.648442 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-23d71954-abed-4da5-bd6c-f2a4ccb6d52d tempest-GroupsTest-1522737571 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:34.679084 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-23d71954-abed-4da5-bd6c-f2a4ccb6d52d tempest-GroupsTest-1522737571 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:39:34.684018 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-23d71954-abed-4da5-bd6c-f2a4ccb6d52d tempest-GroupsTest-1522737571 None] Delete group completed successfully.
Jul 16 21:39:35.673554 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f31a35e8-94b9-4042-9163-fdd02dd9a652 tempest-TestVolumeBootPattern-1625426921 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:39:35.835934 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f31a35e8-94b9-4042-9163-fdd02dd9a652 tempest-TestVolumeBootPattern-1625426921 None] deleting parent snapshot volume-08629f8b-2fa4-47c6-a3f4-f26714ae06dc.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:39:38.413412 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:39:38.414142 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:38.439182 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:38.481740 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:39:38.603986 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-f31a35e8-94b9-4042-9163-fdd02dd9a652 tempest-TestVolumeBootPattern-1625426921 None] Created reservations ['ce536a43-8838-498c-acca-089325f35629', 'ef6d534c-e78b-4f00-bf24-493a87684d8f', 'e80e3fcf-fa36-482a-8dd0-b6d0277a108f', 'e011d031-05fd-40cb-9be5-1dee490dcdce'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:39:38.747619 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f31a35e8-94b9-4042-9163-fdd02dd9a652 tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:38.774611 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f31a35e8-94b9-4042-9163-fdd02dd9a652 tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:38.802652 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-f31a35e8-94b9-4042-9163-fdd02dd9a652 tempest-TestVolumeBootPattern-1625426921 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:39:38.807915 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f31a35e8-94b9-4042-9163-fdd02dd9a652 tempest-TestVolumeBootPattern-1625426921 None] Deleted volume successfully.
Jul 16 21:39:38.854477 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f31a35e8-94b9-4042-9163-fdd02dd9a652 tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-08629f8b-2fa4-47c6-a3f4-f26714ae06dc-delete_volume" released by "delete_volume" :: held 9.285s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:39:40.176755 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:39:40.197146 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Flow 'volume_create_manager' (160addcf-8f13-4188-aa13-cfe07e39b3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:39:40.203385 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74412deb-033a-4e06-8b54-395149340a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:40.220290 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74412deb-033a-4e06-8b54-395149340a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-50417735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=cb83e900-2518-45c5-9a34-d536cf6c7a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b533f85aeddf4d8db05f2c53a61befc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:39:40Z,use_quota=True,user_id='62209b9802ab46c3b3d094d4d1ad86fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:40.226214 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffe97ed-e58c-4043-b843-2afc3727038f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:40.232036 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffe97ed-e58c-4043-b843-2afc3727038f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:40.235377 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1db7df-62ef-4fea-9778-247a33e84ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:40.321347 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1db7df-62ef-4fea-9778-247a33e84ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb83e900-2518-45c5-9a34-d536cf6c7a3f', 'volume_name': 'volume-cb83e900-2518-45c5-9a34-d536cf6c7a3f', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9591983610>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:40.326667 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7561c5ab-5ccb-4be1-82aa-85681a50d9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:40.330775 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7561c5ab-5ccb-4be1-82aa-85681a50d9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:40.336168 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687bae3f-7a2a-415c-a8e5-569873bfa319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:40.337309 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Volume cb83e900-2518-45c5-9a34-d536cf6c7a3f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb83e900-2518-45c5-9a34-d536cf6c7a3f', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9591983610>}
Jul 16 21:39:40.337897 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Cloning cb83e900-2518-45c5-9a34-d536cf6c7a3f from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9  at location (None, None). {{(pid=131857) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Jul 16 21:39:40.338815 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Acquiring lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" by "_prepare_image_cache_entry" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:39:40.355309 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" acquired by "_prepare_image_cache_entry" :: waited 0.016s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:39:40.361489 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=53,cinder:INSERT=11,cinder:UPDATE=36 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:39:40.426714 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 39, 40, 360615)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:39:40.427184 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:39:40.427591 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Found cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Jul 16 21:39:40.432172 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" released by "_prepare_image_cache_entry" :: held 0.077s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:39:40.433100 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Attempting to retrieve cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Jul 16 21:39:40.439562 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 39, 40, 437090)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:39:40.439982 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:39:40.440465 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Creating from source image-volume b59b3901-b32a-4d92-81b0-6b99e88e4517 {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Jul 16 21:39:40.467040 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:40.643466 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] creating snapshot='volume-cb83e900-2518-45c5-9a34-d536cf6c7a3f.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:39:42.781293 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] cloning 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517@volume-cb83e900-2518-45c5-9a34-d536cf6c7a3f.clone_snap' to 'volume-cb83e900-2518-45c5-9a34-d536cf6c7a3f' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:39:42.851857 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:39:42.872337 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Flow 'volume_create_manager' (56969352-84d4-48dc-84cb-9caa3a7f598a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:39:42.878613 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776b6de0-b80b-4ee6-b9f1-26ae2cdc96d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:42.895864 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776b6de0-b80b-4ee6-b9f1-26ae2cdc96d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1448308998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5062ab88-a7a9-4f32-ac7a-d24c6c2a0c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e85b8789324a8a91a6aae30eefa54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:39:41Z,use_quota=True,user_id='6d09783924f1447cb076f502ad7a2450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1bf1dbe-b527-48ac-afe1-b3fd3d6189de),volume_type_id=b1bf1dbe-b527-48ac-afe1-b3fd3d6189de)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:42.901123 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a101e9a4-6eb2-4082-9ffa-b3ef1bf8731c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:42.905303 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a101e9a4-6eb2-4082-9ffa-b3ef1bf8731c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:42.910221 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66440ef-9eda-4e48-867c-00f43871a31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:42.915247 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66440ef-9eda-4e48-867c-00f43871a31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5062ab88-a7a9-4f32-ac7a-d24c6c2a0c43', 'volume_name': 'volume-5062ab88-a7a9-4f32-ac7a-d24c6c2a0c43', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:42.920064 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb35251-fd88-4178-b6a1-2eb779f67575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:42.923941 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb35251-fd88-4178-b6a1-2eb779f67575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:42.929680 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e3edc8-fb4d-47a9-b95b-2768a8c24f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:42.930739 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Volume 5062ab88-a7a9-4f32-ac7a-d24c6c2a0c43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5062ab88-a7a9-4f32-ac7a-d24c6c2a0c43', 'volume_size': 1}
Jul 16 21:39:42.931158 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] creating volume 'volume-5062ab88-a7a9-4f32-ac7a-d24c6c2a0c43' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:39:42.931921 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:43.777771 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] extra_specs: {} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:39:43.778147 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] extra_specs: {} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:39:43.781970 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e3edc8-fb4d-47a9-b95b-2768a8c24f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5062ab88-a7a9-4f32-ac7a-d24c6c2a0c43', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:43.794016 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecaa02d-13e1-4540-adea-c43e829be93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:43.877981 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Volume volume-5062ab88-a7a9-4f32-ac7a-d24c6c2a0c43 (5062ab88-a7a9-4f32-ac7a-d24c6c2a0c43): created successfully
Jul 16 21:39:43.882429 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecaa02d-13e1-4540-adea-c43e829be93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:43.887782 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Flow 'volume_create_manager' (56969352-84d4-48dc-84cb-9caa3a7f598a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:39:43.970000 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d1b2cc9c-edb7-4f8e-896a-e57bcfddc214 tempest-VolumeTypesAccessTest-1046709804 None] Created volume successfully.
Jul 16 21:39:44.487040 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945.deleted is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:39:44.488328 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:39:44.489375 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:39:45.078639 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:39:45.079448 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Marking volume cb83e900-2518-45c5-9a34-d536cf6c7a3f as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:39:45.147588 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Copying metadata from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 to cb83e900-2518-45c5-9a34-d536cf6c7a3f. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Jul 16 21:39:45.147950 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Creating volume glance metadata for volume cb83e900-2518-45c5-9a34-d536cf6c7a3f backed by image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131857) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Jul 16 21:39:45.166888 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=55,cinder:UPDATE=35,cinder:INSERT=8,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:39:45.275843 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687bae3f-7a2a-415c-a8e5-569873bfa319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb83e900-2518-45c5-9a34-d536cf6c7a3f', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9591983610>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:45.280417 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebb2db6-2f4e-4b30-8f84-7df1d93f4c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:39:45.295427 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-59f3f8c9-a0b3-4d42-9154-12501566b53d tempest-VolumeTypesAccessTest-1046709804 None] Acquiring lock "cinder-5062ab88-a7a9-4f32-ac7a-d24c6c2a0c43-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:39:45.300910 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-59f3f8c9-a0b3-4d42-9154-12501566b53d tempest-VolumeTypesAccessTest-1046709804 None] Lock "cinder-5062ab88-a7a9-4f32-ac7a-d24c6c2a0c43-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:39:45.346327 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Volume volume-cb83e900-2518-45c5-9a34-d536cf6c7a3f (cb83e900-2518-45c5-9a34-d536cf6c7a3f): created successfully
Jul 16 21:39:45.350437 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebb2db6-2f4e-4b30-8f84-7df1d93f4c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:39:45.355978 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Flow 'volume_create_manager' (160addcf-8f13-4188-aa13-cfe07e39b3e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:39:45.382878 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-59f3f8c9-a0b3-4d42-9154-12501566b53d tempest-VolumeTypesAccessTest-1046709804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:45.517780 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-59f3f8c9-a0b3-4d42-9154-12501566b53d tempest-VolumeTypesAccessTest-1046709804 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:39:45.518197 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-59f3f8c9-a0b3-4d42-9154-12501566b53d tempest-VolumeTypesAccessTest-1046709804 None] Volume volume-5062ab88-a7a9-4f32-ac7a-d24c6c2a0c43 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:39:45.575551 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-59f3f8c9-a0b3-4d42-9154-12501566b53d tempest-VolumeTypesAccessTest-1046709804 None] deleting rbd volume volume-5062ab88-a7a9-4f32-ac7a-d24c6c2a0c43 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:39:45.578251 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-0edb8307-a109-441d-bc0f-07d4047d8618 tempest-TestVolumeBootPattern-1625426921 None] Created volume successfully.
Jul 16 21:39:49.638928 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-59f3f8c9-a0b3-4d42-9154-12501566b53d tempest-VolumeTypesAccessTest-1046709804 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1040628993 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1040628993, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:39:49.639858 ncdv-master-1 cinder-volume[131857]: WARNING cinder.quota [None req-59f3f8c9-a0b3-4d42-9154-12501566b53d tempest-VolumeTypesAccessTest-1046709804 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1040628993 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1040628993, it is now deprecated. Please use the default quota class for default quota.
Jul 16 21:39:49.706796 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-59f3f8c9-a0b3-4d42-9154-12501566b53d tempest-VolumeTypesAccessTest-1046709804 None] Created reservations ['b2958e3d-0d59-4b74-943a-dd4ed5ec307d', 'cde04d3f-128b-4e1e-bfaf-da1cda32285b', '8ab10c76-f904-49c4-a599-24210ca25fff', 'aa29b70f-b13b-4969-92e9-cf5ef39ad4c6'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:39:49.896930 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-59f3f8c9-a0b3-4d42-9154-12501566b53d tempest-VolumeTypesAccessTest-1046709804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:49.925106 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-59f3f8c9-a0b3-4d42-9154-12501566b53d tempest-VolumeTypesAccessTest-1046709804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:39:49.969509 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-59f3f8c9-a0b3-4d42-9154-12501566b53d tempest-VolumeTypesAccessTest-1046709804 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:39:49.974392 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-59f3f8c9-a0b3-4d42-9154-12501566b53d tempest-VolumeTypesAccessTest-1046709804 None] Deleted volume successfully.
Jul 16 21:39:50.040259 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-5deb236a-d39c-46d5-9195-c61e16f4d607 req-54f7951d-a0c7-4d84-a94d-ed020a0101c3 tempest-TestVolumeBootPattern-1625426921 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:39:50.098363 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-59f3f8c9-a0b3-4d42-9154-12501566b53d tempest-VolumeTypesAccessTest-1046709804 None] Lock "cinder-5062ab88-a7a9-4f32-ac7a-d24c6c2a0c43-delete_volume" released by "delete_volume" :: held 4.797s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:39:50.836156 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-5deb236a-d39c-46d5-9195-c61e16f4d607 req-54f7951d-a0c7-4d84-a94d-ed020a0101c3 tempest-TestVolumeBootPattern-1625426921 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.796s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:39:50.836860 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-5deb236a-d39c-46d5-9195-c61e16f4d607 req-54f7951d-a0c7-4d84-a94d-ed020a0101c3 tempest-TestVolumeBootPattern-1625426921 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cb83e900-2518-45c5-9a34-d536cf6c7a3f', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'cb83e900-2518-45c5-9a34-d536cf6c7a3f', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:39:50.935687 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-5deb236a-d39c-46d5-9195-c61e16f4d607 req-54f7951d-a0c7-4d84-a94d-ed020a0101c3 tempest-TestVolumeBootPattern-1625426921 None] Connection info returned from driver {'name': 'volumes/volume-cb83e900-2518-45c5-9a34-d536cf6c7a3f', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cb83e900-2518-45c5-9a34-d536cf6c7a3f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ec1f7961-d7a3-4aeb-9e33-9c7a71d2b333'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:39:51.104291 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-5deb236a-d39c-46d5-9195-c61e16f4d607 req-54f7951d-a0c7-4d84-a94d-ed020a0101c3 tempest-TestVolumeBootPattern-1625426921 None] attachment_update completed successfully.
Jul 16 21:40:01.096800 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=26,cinder:DELETE=2,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:40:02.588675 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:40:02.609501 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Flow 'volume_create_manager' (efd67477-8808-4c26-bc88-9c0e639701ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:40:02.616210 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb3bb24-2ad1-4a4b-b042-cd3d7db8bd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:02.632926 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb3bb24-2ad1-4a4b-b042-cd3d7db8bd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-883128211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=23b90fe9-c2ed-4644-bbbf-3ec75a235453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e042314a2f074bdf983537ed7c669463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:40:02Z,use_quota=True,user_id='e17d71be37154033ae1e0a8d8db8606e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:02.638096 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f75401-913a-485e-85d9-00d7e5d32fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:02.642199 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f75401-913a-485e-85d9-00d7e5d32fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:02.648103 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86cdc69f-fd92-4c6e-b77e-544492b7683f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:02.728102 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86cdc69f-fd92-4c6e-b77e-544492b7683f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '23b90fe9-c2ed-4644-bbbf-3ec75a235453', 'volume_name': 'volume-23b90fe9-c2ed-4644-bbbf-3ec75a235453', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f959193be20>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:02.733189 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644b50a1-8663-4baa-a25b-a68d84b256e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:02.737119 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644b50a1-8663-4baa-a25b-a68d84b256e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:02.741723 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16148c3a-2b1e-4fe4-a3ff-a37c44039470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:02.742821 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Volume 23b90fe9-c2ed-4644-bbbf-3ec75a235453: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-23b90fe9-c2ed-4644-bbbf-3ec75a235453', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f959193be20>}
Jul 16 21:40:02.743472 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Cloning 23b90fe9-c2ed-4644-bbbf-3ec75a235453 from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9  at location (None, None). {{(pid=131857) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Jul 16 21:40:02.744244 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Acquiring lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" by "_prepare_image_cache_entry" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:40:02.751559 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:40:02.809586 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 40, 2, 755728)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:40:02.810118 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:40:02.810552 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Found cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Jul 16 21:40:02.815382 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" released by "_prepare_image_cache_entry" :: held 0.064s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:40:02.816464 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Attempting to retrieve cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Jul 16 21:40:02.827160 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 40, 2, 820105)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:40:02.827591 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:40:02.827986 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Creating from source image-volume b59b3901-b32a-4d92-81b0-6b99e88e4517 {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Jul 16 21:40:02.842481 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:02.991740 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] creating snapshot='volume-23b90fe9-c2ed-4644-bbbf-3ec75a235453.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:40:04.198227 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] cloning 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517@volume-23b90fe9-c2ed-4644-bbbf-3ec75a235453.clone_snap' to 'volume-23b90fe9-c2ed-4644-bbbf-3ec75a235453' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:40:04.592565 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-5da33d32-efea-4175-97da-1ed743f867b9 tempest-VolumesSnapshotTestJSON-1954720325 None] Created reservations ['2b650387-dfef-4e6b-97d9-226ea78ed751', '81d37572-210c-493f-bfc8-8a9f1db48d08', 'cfa9b164-8e8a-4b51-b2cf-1ae16850d06d', '6a4423b4-5e06-4063-94be-88087779a975'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:40:04.792968 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-5da33d32-efea-4175-97da-1ed743f867b9 tempest-VolumesSnapshotTestJSON-1954720325 None] Delete snapshot completed successfully.
Jul 16 21:40:04.797471 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5da33d32-efea-4175-97da-1ed743f867b9 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-14479b68-9962-455e-af09-f2bda0ea444a-delete_snapshot" released by "delete_snapshot" :: held 32.691s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:40:05.293280 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f9fa59d5-cc92-40c0-b4be-3a948b01ffc6 tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-2c314d03-6cfa-4aa7-9278-9bd817032b76-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:40:05.308385 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f9fa59d5-cc92-40c0-b4be-3a948b01ffc6 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-2c314d03-6cfa-4aa7-9278-9bd817032b76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:40:05.310425 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f9fa59d5-cc92-40c0-b4be-3a948b01ffc6 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:05.768855 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945.deleted is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:40:05.770493 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:40:05.770875 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:40:06.174710 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:40:06.175372 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Marking volume 23b90fe9-c2ed-4644-bbbf-3ec75a235453 as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:40:06.272426 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Copying metadata from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 to 23b90fe9-c2ed-4644-bbbf-3ec75a235453. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Jul 16 21:40:06.273166 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Creating volume glance metadata for volume 23b90fe9-c2ed-4644-bbbf-3ec75a235453 backed by image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131857) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Jul 16 21:40:06.288843 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=57,cinder:UPDATE=26,cinder:INSERT=17 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:40:06.469917 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16148c3a-2b1e-4fe4-a3ff-a37c44039470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23b90fe9-c2ed-4644-bbbf-3ec75a235453', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f959193be20>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:06.474628 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da67e9b-86e6-45b4-ba27-cfaa7348e100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:06.587137 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Volume volume-23b90fe9-c2ed-4644-bbbf-3ec75a235453 (23b90fe9-c2ed-4644-bbbf-3ec75a235453): created successfully
Jul 16 21:40:06.590754 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da67e9b-86e6-45b4-ba27-cfaa7348e100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:06.596053 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Flow 'volume_create_manager' (efd67477-8808-4c26-bc88-9c0e639701ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:40:06.666652 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e8a80850-c2cc-4713-ba22-599a270d5cfe tempest-VolumesImageMetadata-431942009 None] Created volume successfully.
Jul 16 21:40:07.294943 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-e32f47cc-212a-46f3-858c-3b7ee9c1425c req-fdef5689-f796-4510-820f-8c8aebf92c34 tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:08.204372 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-0b51ac84-f026-42e8-92d2-998f79d59d06 tempest-VolumesImageMetadata-431942009 None] Acquiring lock "cinder-23b90fe9-c2ed-4644-bbbf-3ec75a235453-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:40:08.214825 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-0b51ac84-f026-42e8-92d2-998f79d59d06 tempest-VolumesImageMetadata-431942009 None] Lock "cinder-23b90fe9-c2ed-4644-bbbf-3ec75a235453-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:40:08.375800 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0b51ac84-f026-42e8-92d2-998f79d59d06 tempest-VolumesImageMetadata-431942009 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:08.614855 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0b51ac84-f026-42e8-92d2-998f79d59d06 tempest-VolumesImageMetadata-431942009 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:40:08.731938 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0b51ac84-f026-42e8-92d2-998f79d59d06 tempest-VolumesImageMetadata-431942009 None] deleting rbd volume volume-23b90fe9-c2ed-4644-bbbf-3ec75a235453 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:40:09.324142 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-e32f47cc-212a-46f3-858c-3b7ee9c1425c req-fdef5689-f796-4510-820f-8c8aebf92c34 tempest-TestVolumeBootPattern-1625426921 None] Create snapshot completed successfully
Jul 16 21:40:13.285116 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:40:13.314579 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Flow 'volume_create_manager' (7e94588e-cd33-4b9d-90cb-061fd3037fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:40:13.320891 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71317fa-dce8-46a4-b638-d0a228ac82be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:13.336752 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71317fa-dce8-46a4-b638-d0a228ac82be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:40:13Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c9007579-c8d4-4034-bc5d-edb25e4d8ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b533f85aeddf4d8db05f2c53a61befc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2dc18b93-7077-47bd-a336-808d90e32062,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:40:13Z,use_quota=True,user_id='62209b9802ab46c3b3d094d4d1ad86fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:13.341937 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22bc1093-71bb-45b6-bc2e-5590541bcc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:13.346063 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22bc1093-71bb-45b6-bc2e-5590541bcc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:13.351034 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f34ffe6-de0c-44cc-a28d-63e64846707f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:13.354948 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f34ffe6-de0c-44cc-a28d-63e64846707f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c9007579-c8d4-4034-bc5d-edb25e4d8ba8', 'volume_name': 'volume-c9007579-c8d4-4034-bc5d-edb25e4d8ba8', 'volume_size': 1, 'snapshot_id': '2dc18b93-7077-47bd-a336-808d90e32062'}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:13.360547 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf40432d-6870-4fff-8846-6ac4b8be8fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:13.364456 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf40432d-6870-4fff-8846-6ac4b8be8fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:13.368997 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c17522f-d7be-4b4c-bae1-8a8e4d3240b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:13.370049 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Volume c9007579-c8d4-4034-bc5d-edb25e4d8ba8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c9007579-c8d4-4034-bc5d-edb25e4d8ba8', 'volume_size': 1, 'snapshot_id': '2dc18b93-7077-47bd-a336-808d90e32062'}
Jul 16 21:40:13.393844 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] cloning volumes/volume-cb83e900-2518-45c5-9a34-d536cf6c7a3f@snapshot-2dc18b93-7077-47bd-a336-808d90e32062 to volume-c9007579-c8d4-4034-bc5d-edb25e4d8ba8 {{(pid=131857) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}}
Jul 16 21:40:13.394493 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:13.503627 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:13.691375 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0b51ac84-f026-42e8-92d2-998f79d59d06 tempest-VolumesImageMetadata-431942009 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:40:14.023755 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0b51ac84-f026-42e8-92d2-998f79d59d06 tempest-VolumesImageMetadata-431942009 None] deleting parent snapshot volume-23b90fe9-c2ed-4644-bbbf-3ec75a235453.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:40:16.934192 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:40:16.934882 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:40:16.962559 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Marking volume c9007579-c8d4-4034-bc5d-edb25e4d8ba8 as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:40:17.055275 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Copying metadata from snapshot 2dc18b93-7077-47bd-a336-808d90e32062 to c9007579-c8d4-4034-bc5d-edb25e4d8ba8. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:430}}
Jul 16 21:40:17.067311 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=63,cinder:UPDATE=16,cinder:INSERT=20,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:40:17.079117 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-0b51ac84-f026-42e8-92d2-998f79d59d06 tempest-VolumesImageMetadata-431942009 None] Created reservations ['6434020b-9e89-4fd5-91dd-5c30a436e771', '1eab417a-706a-4c4f-b34c-8c25ed822ae3', '821bb538-3dcd-474d-a2d2-b2139168280c', '850f7438-0587-458b-8f16-ea64c2473524'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:40:17.187520 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c17522f-d7be-4b4c-bae1-8a8e4d3240b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9007579-c8d4-4034-bc5d-edb25e4d8ba8', 'volume_size': 1, 'snapshot_id': '2dc18b93-7077-47bd-a336-808d90e32062'}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:17.192057 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76914484-1d74-41ae-97f9-e1ac2dd54b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:17.256163 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Volume volume-c9007579-c8d4-4034-bc5d-edb25e4d8ba8 (c9007579-c8d4-4034-bc5d-edb25e4d8ba8): created successfully
Jul 16 21:40:17.260911 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76914484-1d74-41ae-97f9-e1ac2dd54b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:17.268004 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Flow 'volume_create_manager' (7e94588e-cd33-4b9d-90cb-061fd3037fd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:40:17.271463 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0b51ac84-f026-42e8-92d2-998f79d59d06 tempest-VolumesImageMetadata-431942009 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:17.311231 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0b51ac84-f026-42e8-92d2-998f79d59d06 tempest-VolumesImageMetadata-431942009 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:17.345432 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-0b51ac84-f026-42e8-92d2-998f79d59d06 tempest-VolumesImageMetadata-431942009 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:40:17.351664 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-0b51ac84-f026-42e8-92d2-998f79d59d06 tempest-VolumesImageMetadata-431942009 None] Deleted volume successfully.
Jul 16 21:40:17.444520 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-0b51ac84-f026-42e8-92d2-998f79d59d06 tempest-VolumesImageMetadata-431942009 None] Lock "cinder-23b90fe9-c2ed-4644-bbbf-3ec75a235453-delete_volume" released by "delete_volume" :: held 9.230s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:40:17.489700 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-a6db53a4-0a85-458c-9e4f-e3d9fe08a538 tempest-TestVolumeBootPattern-1625426921 None] Created volume successfully.
Jul 16 21:40:19.769488 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-d1f8fae3-ef1d-4db1-8f89-8b41c1e6c81f tempest-TestVolumeBootPattern-1625426921 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:40:20.582694 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-d1f8fae3-ef1d-4db1-8f89-8b41c1e6c81f tempest-TestVolumeBootPattern-1625426921 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.813s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:40:20.583548 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-d1f8fae3-ef1d-4db1-8f89-8b41c1e6c81f tempest-TestVolumeBootPattern-1625426921 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c9007579-c8d4-4034-bc5d-edb25e4d8ba8', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'c9007579-c8d4-4034-bc5d-edb25e4d8ba8', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:40:20.644061 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-d1f8fae3-ef1d-4db1-8f89-8b41c1e6c81f tempest-TestVolumeBootPattern-1625426921 None] Connection info returned from driver {'name': 'volumes/volume-c9007579-c8d4-4034-bc5d-edb25e4d8ba8', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c9007579-c8d4-4034-bc5d-edb25e4d8ba8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2ab71d0c-6455-40f5-bfab-f30ae99961ec'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:40:20.732053 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-36c8884e-5ba4-40e4-b094-46e28b587ff4 req-d1f8fae3-ef1d-4db1-8f89-8b41c1e6c81f tempest-TestVolumeBootPattern-1625426921 None] attachment_update completed successfully.
Jul 16 21:40:22.285413 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:40:22.308991 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Flow 'volume_create_manager' (902cfbd1-0828-4a23-b5b2-cf951dcf4ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:40:22.316485 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2947c26-436e-4ca2-9ea9-439bdc15e7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:22.357670 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2947c26-436e-4ca2-9ea9-439bdc15e7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-227053358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=cb3f7452-2ab9-4680-b166-6cc0d631eb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bfdc91cc1b4319919e992561ef136e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:40:22Z,use_quota=True,user_id='054fa96e163d4cb0b04b343cff0645ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:22.363934 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194960fb-d2ac-4194-aa3b-64a65e4e7244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:22.368039 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194960fb-d2ac-4194-aa3b-64a65e4e7244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:22.372977 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc6c34e-0da4-4f96-a8ff-016ee8bebc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:22.377742 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc6c34e-0da4-4f96-a8ff-016ee8bebc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb3f7452-2ab9-4680-b166-6cc0d631eb9e', 'volume_name': 'volume-cb3f7452-2ab9-4680-b166-6cc0d631eb9e', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:22.382580 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8f3516-ae53-47eb-a19e-cf109cc761a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:22.386424 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8f3516-ae53-47eb-a19e-cf109cc761a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:22.390980 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32fbc2b6-2846-4c9d-8c2f-84d99a6e6572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:22.392044 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Volume cb3f7452-2ab9-4680-b166-6cc0d631eb9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb3f7452-2ab9-4680-b166-6cc0d631eb9e', 'volume_size': 1}
Jul 16 21:40:22.392446 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] creating volume 'volume-cb3f7452-2ab9-4680-b166-6cc0d631eb9e' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:40:22.393402 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:23.013302 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:40:23.013697 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:40:23.018371 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32fbc2b6-2846-4c9d-8c2f-84d99a6e6572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb3f7452-2ab9-4680-b166-6cc0d631eb9e', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:23.022831 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254a9963-0ba4-4805-9bb1-87abfc3661d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:23.118285 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Volume volume-cb3f7452-2ab9-4680-b166-6cc0d631eb9e (cb3f7452-2ab9-4680-b166-6cc0d631eb9e): created successfully
Jul 16 21:40:23.122173 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254a9963-0ba4-4805-9bb1-87abfc3661d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:23.127726 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Flow 'volume_create_manager' (902cfbd1-0828-4a23-b5b2-cf951dcf4ef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:40:23.209672 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-7d428df6-50ff-48fa-94cd-120d67fee8e3 tempest-VolumesTransfersTest-1487079389 None] Created volume successfully.
Jul 16 21:40:25.148084 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-753f6f97-f2e1-46da-a647-7a6b64da3c7e tempest-VolumesTransfersTest-609370559 None] Transfer volume completed successfully.
Jul 16 21:40:26.015469 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a9450dfa-21c2-471a-b289-174a47cbcb02 tempest-VolumesTransfersTest-1595834366 None] Acquiring lock "cinder-cb3f7452-2ab9-4680-b166-6cc0d631eb9e-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:40:26.030459 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a9450dfa-21c2-471a-b289-174a47cbcb02 tempest-VolumesTransfersTest-1595834366 None] Lock "cinder-cb3f7452-2ab9-4680-b166-6cc0d631eb9e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:40:26.113328 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a9450dfa-21c2-471a-b289-174a47cbcb02 tempest-VolumesTransfersTest-1595834366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:26.197752 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a9450dfa-21c2-471a-b289-174a47cbcb02 tempest-VolumesTransfersTest-1595834366 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:40:26.198397 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a9450dfa-21c2-471a-b289-174a47cbcb02 tempest-VolumesTransfersTest-1595834366 None] Volume volume-cb3f7452-2ab9-4680-b166-6cc0d631eb9e is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:40:26.238286 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a9450dfa-21c2-471a-b289-174a47cbcb02 tempest-VolumesTransfersTest-1595834366 None] deleting rbd volume volume-cb3f7452-2ab9-4680-b166-6cc0d631eb9e {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:40:29.698000 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=57,cinder:INSERT=19,cinder:DELETE=2,cinder:UPDATE=22 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:40:29.792629 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-a9450dfa-21c2-471a-b289-174a47cbcb02 tempest-VolumesTransfersTest-1595834366 None] Created reservations ['c7344d3c-ba87-46ff-b6c3-a7214a1c9b95', '38d35551-866a-455d-908f-084b2a1410fd', 'd0b1bb1c-bf90-40d7-b2f4-7829f11463ac', '714ddf17-94fd-44ec-a09d-f93e4119dc84'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:40:29.941209 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a9450dfa-21c2-471a-b289-174a47cbcb02 tempest-VolumesTransfersTest-1595834366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:29.965893 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a9450dfa-21c2-471a-b289-174a47cbcb02 tempest-VolumesTransfersTest-1595834366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:30.002404 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-a9450dfa-21c2-471a-b289-174a47cbcb02 tempest-VolumesTransfersTest-1595834366 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:40:30.006853 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-a9450dfa-21c2-471a-b289-174a47cbcb02 tempest-VolumesTransfersTest-1595834366 None] Deleted volume successfully.
Jul 16 21:40:30.087403 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a9450dfa-21c2-471a-b289-174a47cbcb02 tempest-VolumesTransfersTest-1595834366 None] Lock "cinder-cb3f7452-2ab9-4680-b166-6cc0d631eb9e-delete_volume" released by "delete_volume" :: held 4.058s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:40:30.982609 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:40:31.003792 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Flow 'volume_create_manager' (289d5ebf-fcc8-44ec-ac9a-bc09d50bcf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:40:31.010001 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179d2611-d8cd-4140-b852-3b5b3d81c78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:31.027639 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179d2611-d8cd-4140-b852-3b5b3d81c78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1830584937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d683c5fe-1991-4715-a329-048328587b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bfdc91cc1b4319919e992561ef136e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:40:31Z,use_quota=True,user_id='054fa96e163d4cb0b04b343cff0645ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:31.033619 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b0bc3c-ebda-4756-9200-0fcb1c11a856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:31.038972 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b0bc3c-ebda-4756-9200-0fcb1c11a856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:31.044248 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a022a2-03f1-4285-ae8a-7a101b9186f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:31.049515 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a022a2-03f1-4285-ae8a-7a101b9186f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd683c5fe-1991-4715-a329-048328587b50', 'volume_name': 'volume-d683c5fe-1991-4715-a329-048328587b50', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:31.055256 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f99727-7549-4964-8e14-4c910de35d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:31.059608 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f99727-7549-4964-8e14-4c910de35d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:31.064854 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ecd50d-4651-4b73-abd7-9368cf352911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:31.065988 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Volume d683c5fe-1991-4715-a329-048328587b50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d683c5fe-1991-4715-a329-048328587b50', 'volume_size': 1}
Jul 16 21:40:31.066369 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] creating volume 'volume-d683c5fe-1991-4715-a329-048328587b50' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:40:31.067159 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:31.914823 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:40:31.915501 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:40:31.927177 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ecd50d-4651-4b73-abd7-9368cf352911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d683c5fe-1991-4715-a329-048328587b50', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:31.927799 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260762e9-c22b-4eee-b96c-9739a79fc979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:32.016129 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Volume volume-d683c5fe-1991-4715-a329-048328587b50 (d683c5fe-1991-4715-a329-048328587b50): created successfully
Jul 16 21:40:32.022695 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260762e9-c22b-4eee-b96c-9739a79fc979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:32.031809 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Flow 'volume_create_manager' (289d5ebf-fcc8-44ec-ac9a-bc09d50bcf00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:40:32.101304 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-0ba54ac4-0541-47f1-8e09-737efa5c6e5b tempest-VolumesTransfersTest-1487079389 None] Created volume successfully.
Jul 16 21:40:33.496976 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5ae5650f-f52a-470d-b2a0-a01511bbe67a tempest-VolumesTransfersTest-1595834366 None] Acquiring lock "cinder-d683c5fe-1991-4715-a329-048328587b50-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:40:33.524340 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5ae5650f-f52a-470d-b2a0-a01511bbe67a tempest-VolumesTransfersTest-1595834366 None] Lock "cinder-d683c5fe-1991-4715-a329-048328587b50-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:40:33.670481 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5ae5650f-f52a-470d-b2a0-a01511bbe67a tempest-VolumesTransfersTest-1595834366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:33.883426 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5ae5650f-f52a-470d-b2a0-a01511bbe67a tempest-VolumesTransfersTest-1595834366 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:40:33.883937 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5ae5650f-f52a-470d-b2a0-a01511bbe67a tempest-VolumesTransfersTest-1595834366 None] Volume volume-d683c5fe-1991-4715-a329-048328587b50 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:40:34.009783 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5ae5650f-f52a-470d-b2a0-a01511bbe67a tempest-VolumesTransfersTest-1595834366 None] deleting rbd volume volume-d683c5fe-1991-4715-a329-048328587b50 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:40:36.792375 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-f9fa59d5-cc92-40c0-b4be-3a948b01ffc6 tempest-VolumesSnapshotTestJSON-1954720325 None] Created reservations ['d2293f2e-0112-4228-bf2f-7f5ee2a7e023', 'dd5cc110-dacf-4209-a939-b14281bd721a', '4be00ffa-707d-4ba0-9507-d252943d33a5', '425a3ade-fa1c-4acf-923b-e8022a24ca1b'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:40:37.001607 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f9fa59d5-cc92-40c0-b4be-3a948b01ffc6 tempest-VolumesSnapshotTestJSON-1954720325 None] Delete snapshot completed successfully.
Jul 16 21:40:37.009316 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f9fa59d5-cc92-40c0-b4be-3a948b01ffc6 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-2c314d03-6cfa-4aa7-9278-9bd817032b76-delete_snapshot" released by "delete_snapshot" :: held 31.700s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:40:38.388457 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-ef3a3d17-f556-435d-95f7-567ef19e85b6 req-a89cd872-4e46-43f2-9b77-c2fd1de696ab tempest-TestVolumeBootPattern-1625426921 None] Terminate volume connection completed successfully.
Jul 16 21:40:38.389527 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-ef3a3d17-f556-435d-95f7-567ef19e85b6 req-a89cd872-4e46-43f2-9b77-c2fd1de696ab tempest-TestVolumeBootPattern-1625426921 None] Deleting attachment 2ab71d0c-6455-40f5-bfab-f30ae99961ec. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:40:38.393603 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-017cca1f-5b10-4bce-b4ef-6be9ff258823 req-2b7d9653-1318-4415-a515-01d0dc1f854f tempest-VolumesSnapshotTestJSON-1954720325 None] Terminate volume connection completed successfully.
Jul 16 21:40:38.394139 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-017cca1f-5b10-4bce-b4ef-6be9ff258823 req-2b7d9653-1318-4415-a515-01d0dc1f854f tempest-VolumesSnapshotTestJSON-1954720325 None] Deleting attachment 7fd9a858-fc39-4a85-ac4e-e94af710e2f9. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:40:38.413328 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:40:38.414689 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:38.473333 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:38.549779 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:40:38.850542 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-ef3a3d17-f556-435d-95f7-567ef19e85b6 req-31971705-bec3-4c3f-825e-fa606835387a tempest-TestVolumeBootPattern-1625426921 None] Acquiring lock "cinder-c9007579-c8d4-4034-bc5d-edb25e4d8ba8-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:40:38.882119 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-ef3a3d17-f556-435d-95f7-567ef19e85b6 req-31971705-bec3-4c3f-825e-fa606835387a tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-c9007579-c8d4-4034-bc5d-edb25e4d8ba8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:40:39.070271 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-ef3a3d17-f556-435d-95f7-567ef19e85b6 req-31971705-bec3-4c3f-825e-fa606835387a tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:39.415522 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-ef3a3d17-f556-435d-95f7-567ef19e85b6 req-31971705-bec3-4c3f-825e-fa606835387a tempest-TestVolumeBootPattern-1625426921 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:40:39.826561 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-ef3a3d17-f556-435d-95f7-567ef19e85b6 req-31971705-bec3-4c3f-825e-fa606835387a tempest-TestVolumeBootPattern-1625426921 None] deleting rbd volume volume-c9007579-c8d4-4034-bc5d-edb25e4d8ba8 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:40:39.855228 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=64,cinder:UPDATE=26,cinder:DELETE=4,cinder:INSERT=6 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:40:39.958577 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-5ae5650f-f52a-470d-b2a0-a01511bbe67a tempest-VolumesTransfersTest-1595834366 None] Created reservations ['95c2d726-71d6-454b-812e-b25e5ba855ae', '4f05cab7-1087-40ae-8953-a4751489df56', '6dc0e476-3db0-4ecd-8e13-6df8cd674582', 'affb5f31-1c12-4585-bd9d-8c80236d5e12'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:40:40.236418 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5ae5650f-f52a-470d-b2a0-a01511bbe67a tempest-VolumesTransfersTest-1595834366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:40.278695 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5ae5650f-f52a-470d-b2a0-a01511bbe67a tempest-VolumesTransfersTest-1595834366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:40.310296 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-5ae5650f-f52a-470d-b2a0-a01511bbe67a tempest-VolumesTransfersTest-1595834366 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:40:40.319594 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-5ae5650f-f52a-470d-b2a0-a01511bbe67a tempest-VolumesTransfersTest-1595834366 None] Deleted volume successfully.
Jul 16 21:40:40.393910 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5ae5650f-f52a-470d-b2a0-a01511bbe67a tempest-VolumesTransfersTest-1595834366 None] Lock "cinder-d683c5fe-1991-4715-a329-048328587b50-delete_volume" released by "delete_volume" :: held 6.870s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:40:43.610998 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-17872c0e-ac24-4729-92fa-f812c9ce3673 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:46.919062 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [req-ef3a3d17-f556-435d-95f7-567ef19e85b6 req-31971705-bec3-4c3f-825e-fa606835387a tempest-TestVolumeBootPattern-1625426921 None] Created reservations ['9ff657f5-7081-40a9-b44f-0ab34d424a82', '301f15c5-08b2-4bee-966d-a1433252dcf2', '1463fd65-dae4-403b-9c44-9a186cf5503a', '5045e200-bf8e-4fd3-b46d-230e46502fef'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:40:47.002642 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-17872c0e-ac24-4729-92fa-f812c9ce3673 tempest-VolumesSnapshotTestJSON-1954720325 None] Create snapshot completed successfully
Jul 16 21:40:47.118471 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-ef3a3d17-f556-435d-95f7-567ef19e85b6 req-31971705-bec3-4c3f-825e-fa606835387a tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:47.170272 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-ef3a3d17-f556-435d-95f7-567ef19e85b6 req-31971705-bec3-4c3f-825e-fa606835387a tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:47.224074 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [req-ef3a3d17-f556-435d-95f7-567ef19e85b6 req-31971705-bec3-4c3f-825e-fa606835387a tempest-TestVolumeBootPattern-1625426921 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:40:47.229394 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-ef3a3d17-f556-435d-95f7-567ef19e85b6 req-31971705-bec3-4c3f-825e-fa606835387a tempest-TestVolumeBootPattern-1625426921 None] Deleted volume successfully.
Jul 16 21:40:47.346225 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-ef3a3d17-f556-435d-95f7-567ef19e85b6 req-31971705-bec3-4c3f-825e-fa606835387a tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-c9007579-c8d4-4034-bc5d-edb25e4d8ba8-delete_volume" released by "delete_volume" :: held 8.465s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:40:48.032933 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-70881484-37e9-4b11-a888-de04bbd806dc tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-56edf362-58c7-46fc-9a90-b20dcd4524fa-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:40:48.055560 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-70881484-37e9-4b11-a888-de04bbd806dc tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-56edf362-58c7-46fc-9a90-b20dcd4524fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:40:48.057573 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-70881484-37e9-4b11-a888-de04bbd806dc tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:48.283931 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-d09f09e0-7d21-434d-a277-d819c3e7dc80 tempest-TestVolumeBootPattern-1625426921 None] Acquiring lock "cinder-2dc18b93-7077-47bd-a336-808d90e32062-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:40:48.296159 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-d09f09e0-7d21-434d-a277-d819c3e7dc80 tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-2dc18b93-7077-47bd-a336-808d90e32062-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:40:48.298256 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d09f09e0-7d21-434d-a277-d819c3e7dc80 tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:49.263488 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:40:49.297481 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Flow 'volume_create_manager' (d59edd8b-549f-4811-b154-387b4823c345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:40:49.305601 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa718738-f149-4cdc-8437-fba0d2f7a073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:49.335616 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa718738-f149-4cdc-8437-fba0d2f7a073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1611001010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ff4ded37-e86a-4e75-a728-854bffc880e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd61da83cb56412a8757633c22561495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:40:49Z,use_quota=True,user_id='f7948b58ee714cb1bfd4d8364dae19ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:49.342610 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f555cb2-ce30-46ee-8654-48ddb925e5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:49.349535 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f555cb2-ce30-46ee-8654-48ddb925e5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:49.360342 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37aa18f4-a66d-4649-85d2-4ed325ff4d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:49.369746 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37aa18f4-a66d-4649-85d2-4ed325ff4d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff4ded37-e86a-4e75-a728-854bffc880e8', 'volume_name': 'volume-ff4ded37-e86a-4e75-a728-854bffc880e8', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:49.381495 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd3cc7c-189f-493b-8f63-3de8b8a0ce6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:49.389450 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd3cc7c-189f-493b-8f63-3de8b8a0ce6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:49.395999 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a0d080-d493-4720-bfec-ae08ebb52946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:49.397661 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Volume ff4ded37-e86a-4e75-a728-854bffc880e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff4ded37-e86a-4e75-a728-854bffc880e8', 'volume_size': 1}
Jul 16 21:40:49.403136 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] creating volume 'volume-ff4ded37-e86a-4e75-a728-854bffc880e8' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:40:49.403136 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:50.426457 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:40:50.427624 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:40:50.437814 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a0d080-d493-4720-bfec-ae08ebb52946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff4ded37-e86a-4e75-a728-854bffc880e8', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:50.456288 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e85cce-c8bd-4afd-8708-9017cc20202a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:40:50.530975 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Volume volume-ff4ded37-e86a-4e75-a728-854bffc880e8 (ff4ded37-e86a-4e75-a728-854bffc880e8): created successfully
Jul 16 21:40:50.535181 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e85cce-c8bd-4afd-8708-9017cc20202a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:40:50.541909 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Flow 'volume_create_manager' (d59edd8b-549f-4811-b154-387b4823c345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:40:50.620758 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-1457900d-9f67-4f50-921c-9c4ba79020f6 tempest-VolumesActionsTest-484965280 None] Created volume successfully.
Jul 16 21:40:51.618704 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=59,cinder:UPDATE=31,cinder:INSERT=8,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:40:51.724294 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-70881484-37e9-4b11-a888-de04bbd806dc tempest-VolumesSnapshotTestJSON-1954720325 None] Created reservations ['daf190c8-492a-4f03-9275-5e56c2d16827', '43a6e024-1fd0-4127-9bea-805f28ecfd69', '87702906-ffdc-48a5-8fc9-809a111344c3', '0828e562-629d-4ce4-8845-e37ff9ef7d96'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:40:52.020659 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-70881484-37e9-4b11-a888-de04bbd806dc tempest-VolumesSnapshotTestJSON-1954720325 None] Delete snapshot completed successfully.
Jul 16 21:40:52.025287 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-70881484-37e9-4b11-a888-de04bbd806dc tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-56edf362-58c7-46fc-9a90-b20dcd4524fa-delete_snapshot" released by "delete_snapshot" :: held 3.970s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:40:52.942412 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f7ebc2f5-1e0e-488e-bf6f-f692cbb36bd8 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:40:56.495088 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f7ebc2f5-1e0e-488e-bf6f-f692cbb36bd8 tempest-VolumesSnapshotTestJSON-1954720325 None] Create snapshot completed successfully
Jul 16 21:41:08.469123 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-995c8d27-afc3-48a7-a6a4-2f6b498a1d16 tempest-VolumesActionsTest-484965280 None] Acquiring lock "cinder-ff4ded37-e86a-4e75-a728-854bffc880e8" by "attach_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:41:08.481531 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-995c8d27-afc3-48a7-a6a4-2f6b498a1d16 tempest-VolumesActionsTest-484965280 None] Lock "cinder-ff4ded37-e86a-4e75-a728-854bffc880e8" acquired by "attach_volume" :: waited 0.012s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:41:08.695351 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-995c8d27-afc3-48a7-a6a4-2f6b498a1d16 tempest-VolumesActionsTest-484965280 None] Attaching volume ff4ded37-e86a-4e75-a728-854bffc880e8 to instance cc9ed855-3638-40c6-92ae-7a4029ffae5d at mountpoint /dev/sdb on host None.
Jul 16 21:41:08.787335 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-995c8d27-afc3-48a7-a6a4-2f6b498a1d16 tempest-VolumesActionsTest-484965280 None] Attach volume completed successfully.
Jul 16 21:41:08.793139 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-995c8d27-afc3-48a7-a6a4-2f6b498a1d16 tempest-VolumesActionsTest-484965280 None] Lock "cinder-ff4ded37-e86a-4e75-a728-854bffc880e8" released by "attach_volume" :: held 0.312s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:41:08.914539 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-0159b3b9-87fe-436f-8029-1e319ddb0325 tempest-VolumesActionsTest-484965280 None] Acquiring lock "cinder-ff4ded37-e86a-4e75-a728-854bffc880e8-detach_volume" by "detach_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:41:08.923410 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-0159b3b9-87fe-436f-8029-1e319ddb0325 tempest-VolumesActionsTest-484965280 None] Lock "cinder-ff4ded37-e86a-4e75-a728-854bffc880e8-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:41:08.924126 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-0159b3b9-87fe-436f-8029-1e319ddb0325 tempest-VolumesActionsTest-484965280 None] Detaching volume ff4ded37-e86a-4e75-a728-854bffc880e8 from instance cc9ed855-3638-40c6-92ae-7a4029ffae5d.
Jul 16 21:41:09.141618 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-0159b3b9-87fe-436f-8029-1e319ddb0325 tempest-VolumesActionsTest-484965280 None] Detach volume completed successfully.
Jul 16 21:41:09.146412 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-0159b3b9-87fe-436f-8029-1e319ddb0325 tempest-VolumesActionsTest-484965280 None] Lock "cinder-ff4ded37-e86a-4e75-a728-854bffc880e8-detach_volume" released by "detach_volume" :: held 0.223s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:41:10.965527 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:DELETE=3,cinder:SELECT=56,cinder:UPDATE=27,cinder:INSERT=6 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:41:10.972514 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-1a378e7c-8613-4714-bc0a-815020de77ef req-143427f0-0a03-40b4-b3c3-2fdc8c5de1a0 tempest-VolumesSnapshotTestJSON-1954720325 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:41:11.734889 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-1a378e7c-8613-4714-bc0a-815020de77ef req-143427f0-0a03-40b4-b3c3-2fdc8c5de1a0 tempest-VolumesSnapshotTestJSON-1954720325 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.762s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:41:11.735677 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-1a378e7c-8613-4714-bc0a-815020de77ef req-143427f0-0a03-40b4-b3c3-2fdc8c5de1a0 tempest-VolumesSnapshotTestJSON-1954720325 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f4e6fb31-921e-4c81-bf9b-833752a58dfc', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': 'f4e6fb31-921e-4c81-bf9b-833752a58dfc', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:41:11.798299 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-1a378e7c-8613-4714-bc0a-815020de77ef req-143427f0-0a03-40b4-b3c3-2fdc8c5de1a0 tempest-VolumesSnapshotTestJSON-1954720325 None] Connection info returned from driver {'name': 'volumes/volume-f4e6fb31-921e-4c81-bf9b-833752a58dfc', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f4e6fb31-921e-4c81-bf9b-833752a58dfc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3c40ce74-ad9a-4d5a-bb10-3555332bb911'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:41:11.897096 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-1a378e7c-8613-4714-bc0a-815020de77ef req-143427f0-0a03-40b4-b3c3-2fdc8c5de1a0 tempest-VolumesSnapshotTestJSON-1954720325 None] attachment_update completed successfully.
Jul 16 21:41:15.683293 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-93a6bc86-a698-45cd-bb46-8b02dbb920ed tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:41:17.632251 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-93a6bc86-a698-45cd-bb46-8b02dbb920ed tempest-VolumesSnapshotTestJSON-1954720325 None] Create snapshot completed successfully
Jul 16 21:41:19.299850 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-67ad46bc-9302-4721-b595-e347370de240 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:41:19.769765 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-d09f09e0-7d21-434d-a277-d819c3e7dc80 tempest-TestVolumeBootPattern-1625426921 None] Created reservations ['e7bcb2f3-5bba-4dbf-ad6e-b83748e005ae', 'bfb14e74-c4bf-4dc9-b7f3-3a218dace1b5', '587da657-cecd-4ff6-b3d3-61fdc7c3ed91', 'e37b7473-0247-4cda-86e6-ff6f65dae27f'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:41:20.072140 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d09f09e0-7d21-434d-a277-d819c3e7dc80 tempest-TestVolumeBootPattern-1625426921 None] Delete snapshot completed successfully.
Jul 16 21:41:20.079872 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-d09f09e0-7d21-434d-a277-d819c3e7dc80 tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-2dc18b93-7077-47bd-a336-808d90e32062-delete_snapshot" released by "delete_snapshot" :: held 31.783s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:41:21.357782 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-67ad46bc-9302-4721-b595-e347370de240 tempest-VolumesSnapshotTestJSON-1954720325 None] Create snapshot completed successfully
Jul 16 21:41:22.246599 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-49f82618-add6-4b1f-8a3a-8dec7622e31c tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-8a0f87a1-64bc-4b63-ab20-6c969d99e3de-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:41:22.259251 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-49f82618-add6-4b1f-8a3a-8dec7622e31c tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-8a0f87a1-64bc-4b63-ab20-6c969d99e3de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:41:22.274547 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-49f82618-add6-4b1f-8a3a-8dec7622e31c tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:41:22.825828 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=45,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:41:24.008493 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-fc53307f-a8c7-44a7-9bfa-36ae4a80ac95 req-89aabf07-3eae-4abf-be29-ff9c08268fb6 tempest-TestVolumeBootPattern-1625426921 None] Terminate volume connection completed successfully.
Jul 16 21:41:24.009123 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-fc53307f-a8c7-44a7-9bfa-36ae4a80ac95 req-89aabf07-3eae-4abf-be29-ff9c08268fb6 tempest-TestVolumeBootPattern-1625426921 None] Deleting attachment ec1f7961-d7a3-4aeb-9e33-9c7a71d2b333. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:41:24.302021 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-fc53307f-a8c7-44a7-9bfa-36ae4a80ac95 req-aa04ac28-a755-433e-b001-157070d17f6d tempest-TestVolumeBootPattern-1625426921 None] Acquiring lock "cinder-cb83e900-2518-45c5-9a34-d536cf6c7a3f-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:41:24.311695 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-fc53307f-a8c7-44a7-9bfa-36ae4a80ac95 req-aa04ac28-a755-433e-b001-157070d17f6d tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-cb83e900-2518-45c5-9a34-d536cf6c7a3f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:41:24.406287 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-fc53307f-a8c7-44a7-9bfa-36ae4a80ac95 req-aa04ac28-a755-433e-b001-157070d17f6d tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:41:24.901196 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-fc53307f-a8c7-44a7-9bfa-36ae4a80ac95 req-aa04ac28-a755-433e-b001-157070d17f6d tempest-TestVolumeBootPattern-1625426921 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:41:25.022754 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-fc53307f-a8c7-44a7-9bfa-36ae4a80ac95 req-aa04ac28-a755-433e-b001-157070d17f6d tempest-TestVolumeBootPattern-1625426921 None] deleting rbd volume volume-cb83e900-2518-45c5-9a34-d536cf6c7a3f {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:41:28.290240 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-4bf7c792-1ad5-4388-b3af-ec9260739dad tempest-VolumesActionsTest-484965280 None] Acquiring lock "cinder-ff4ded37-e86a-4e75-a728-854bffc880e8" by "attach_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:41:28.298766 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-4bf7c792-1ad5-4388-b3af-ec9260739dad tempest-VolumesActionsTest-484965280 None] Lock "cinder-ff4ded37-e86a-4e75-a728-854bffc880e8" acquired by "attach_volume" :: waited 0.009s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:41:28.443587 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-4bf7c792-1ad5-4388-b3af-ec9260739dad tempest-VolumesActionsTest-484965280 None] Attaching volume ff4ded37-e86a-4e75-a728-854bffc880e8 to instance 9df14d8c-4fff-439d-af43-10a008a7b9d2 at mountpoint /dev/sdb on host None.
Jul 16 21:41:28.512874 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-4bf7c792-1ad5-4388-b3af-ec9260739dad tempest-VolumesActionsTest-484965280 None] Attach volume completed successfully.
Jul 16 21:41:28.517353 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-4bf7c792-1ad5-4388-b3af-ec9260739dad tempest-VolumesActionsTest-484965280 None] Lock "cinder-ff4ded37-e86a-4e75-a728-854bffc880e8" released by "attach_volume" :: held 0.219s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:41:28.673522 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-719f78ba-bcfc-4ed5-b583-f5047f382e82 tempest-VolumesActionsTest-484965280 None] Acquiring lock "cinder-ff4ded37-e86a-4e75-a728-854bffc880e8-detach_volume" by "detach_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:41:28.683002 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-719f78ba-bcfc-4ed5-b583-f5047f382e82 tempest-VolumesActionsTest-484965280 None] Lock "cinder-ff4ded37-e86a-4e75-a728-854bffc880e8-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:41:28.683590 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-719f78ba-bcfc-4ed5-b583-f5047f382e82 tempest-VolumesActionsTest-484965280 None] Detaching volume ff4ded37-e86a-4e75-a728-854bffc880e8 from instance 9df14d8c-4fff-439d-af43-10a008a7b9d2.
Jul 16 21:41:28.855312 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-719f78ba-bcfc-4ed5-b583-f5047f382e82 tempest-VolumesActionsTest-484965280 None] Detach volume completed successfully.
Jul 16 21:41:28.860209 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-719f78ba-bcfc-4ed5-b583-f5047f382e82 tempest-VolumesActionsTest-484965280 None] Lock "cinder-ff4ded37-e86a-4e75-a728-854bffc880e8-detach_volume" released by "detach_volume" :: held 0.178s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:41:30.347560 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-fc53307f-a8c7-44a7-9bfa-36ae4a80ac95 req-aa04ac28-a755-433e-b001-157070d17f6d tempest-TestVolumeBootPattern-1625426921 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:41:30.642031 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-fc53307f-a8c7-44a7-9bfa-36ae4a80ac95 req-aa04ac28-a755-433e-b001-157070d17f6d tempest-TestVolumeBootPattern-1625426921 None] deleting parent snapshot volume-cb83e900-2518-45c5-9a34-d536cf6c7a3f.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:41:32.878159 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [req-fc53307f-a8c7-44a7-9bfa-36ae4a80ac95 req-aa04ac28-a755-433e-b001-157070d17f6d tempest-TestVolumeBootPattern-1625426921 None] Created reservations ['6f4f17ed-1bef-47f3-8af7-6a88c0ae20b8', '3da274f1-a926-4916-9393-737f8f8fefd7', 'd6da63ed-07a7-4ef2-9f11-7b5f4f3125ac', 'a1333aa4-0b2d-43aa-8a53-124f72c1335d'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:41:33.032940 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-fc53307f-a8c7-44a7-9bfa-36ae4a80ac95 req-aa04ac28-a755-433e-b001-157070d17f6d tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:41:33.073619 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-fc53307f-a8c7-44a7-9bfa-36ae4a80ac95 req-aa04ac28-a755-433e-b001-157070d17f6d tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:41:33.161342 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [req-fc53307f-a8c7-44a7-9bfa-36ae4a80ac95 req-aa04ac28-a755-433e-b001-157070d17f6d tempest-TestVolumeBootPattern-1625426921 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:41:33.166414 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-fc53307f-a8c7-44a7-9bfa-36ae4a80ac95 req-aa04ac28-a755-433e-b001-157070d17f6d tempest-TestVolumeBootPattern-1625426921 None] Deleted volume successfully.
Jul 16 21:41:33.231435 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-fc53307f-a8c7-44a7-9bfa-36ae4a80ac95 req-aa04ac28-a755-433e-b001-157070d17f6d tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-cb83e900-2518-45c5-9a34-d536cf6c7a3f-delete_volume" released by "delete_volume" :: held 8.919s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:41:34.036317 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-c7abdf89-cdad-4714-adaf-33bd566f0005 tempest-VolumesActionsTest-484965280 None] Running cmd (subprocess): rbd export --pool volumes volume-ff4ded37-e86a-4e75-a728-854bffc880e8 /opt/stack/data/cinder/conversion/volume-ff4ded37-e86a-4e75-a728-854bffc880e8-bf377075-6b16-46c2-942c-b7ce1e8f346e --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:41:34.736879 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-c7abdf89-cdad-4714-adaf-33bd566f0005 tempest-VolumesActionsTest-484965280 None] CMD "rbd export --pool volumes volume-ff4ded37-e86a-4e75-a728-854bffc880e8 /opt/stack/data/cinder/conversion/volume-ff4ded37-e86a-4e75-a728-854bffc880e8-bf377075-6b16-46c2-942c-b7ce1e8f346e --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.700s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:41:34.746784 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.image_utils [None req-c7abdf89-cdad-4714-adaf-33bd566f0005 tempest-VolumesActionsTest-484965280 None] bf377075-6b16-46c2-942c-b7ce1e8f346e was raw, no need to convert to raw {{(pid=131857) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:851}}
Jul 16 21:41:38.416116 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:41:38.418787 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:41:38.485798 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:41:38.509215 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:41:39.832089 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:41:39.858181 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Flow 'volume_create_manager' (99a04e52-f9cb-4460-8556-19ed0fa11a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:41:39.865775 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adddf0f2-c9af-4f66-997e-2c5f7ffce648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:41:39.887498 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adddf0f2-c9af-4f66-997e-2c5f7ffce648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1285251487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=183425a4-3857-401b-8f23-e0e83f107150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b533f85aeddf4d8db05f2c53a61befc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:41:40Z,use_quota=True,user_id='62209b9802ab46c3b3d094d4d1ad86fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:41:39.894905 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8925621b-4706-4afe-80c3-3545b3f6b858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:41:39.900865 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8925621b-4706-4afe-80c3-3545b3f6b858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:41:39.906202 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33096df-654a-4056-aaf5-25728bc7d99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:41:40.057925 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33096df-654a-4056-aaf5-25728bc7d99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '183425a4-3857-401b-8f23-e0e83f107150', 'volume_name': 'volume-183425a4-3857-401b-8f23-e0e83f107150', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f667280>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:41:40.062285 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d4b5eb-70c7-4e35-92ca-3d32555d412c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:41:40.066752 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d4b5eb-70c7-4e35-92ca-3d32555d412c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:41:40.077611 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff8bf73-2c1d-48e9-8cd0-177ec07d9512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:41:40.078835 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Volume 183425a4-3857-401b-8f23-e0e83f107150: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-183425a4-3857-401b-8f23-e0e83f107150', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f667280>}
Jul 16 21:41:40.079467 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Cloning 183425a4-3857-401b-8f23-e0e83f107150 from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9  at location (None, None). {{(pid=131857) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Jul 16 21:41:40.080299 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Acquiring lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" by "_prepare_image_cache_entry" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:41:40.179976 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" acquired by "_prepare_image_cache_entry" :: waited 0.017s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:41:40.210798 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 41, 40, 101738)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:41:40.211504 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:41:40.212018 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Found cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Jul 16 21:41:40.220511 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" released by "_prepare_image_cache_entry" :: held 0.121s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:41:40.221535 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Attempting to retrieve cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Jul 16 21:41:40.233443 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 41, 40, 228948)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:41:40.234134 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:41:40.234677 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Creating from source image-volume b59b3901-b32a-4d92-81b0-6b99e88e4517 {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Jul 16 21:41:40.252638 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:41:40.558357 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] creating snapshot='volume-183425a4-3857-401b-8f23-e0e83f107150.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:41:42.815621 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] cloning 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517@volume-183425a4-3857-401b-8f23-e0e83f107150.clone_snap' to 'volume-183425a4-3857-401b-8f23-e0e83f107150' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:41:42.836179 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=70,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:41:44.512706 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945.deleted is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:41:44.513939 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:41:44.514264 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:41:44.921817 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:41:44.922559 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Marking volume 183425a4-3857-401b-8f23-e0e83f107150 as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:41:45.015158 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Copying metadata from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 to 183425a4-3857-401b-8f23-e0e83f107150. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Jul 16 21:41:45.016022 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Creating volume glance metadata for volume 183425a4-3857-401b-8f23-e0e83f107150 backed by image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131857) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Jul 16 21:41:45.104723 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff8bf73-2c1d-48e9-8cd0-177ec07d9512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-183425a4-3857-401b-8f23-e0e83f107150', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f667280>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:41:45.111827 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62550df5-6e03-44b2-9395-49bea570bf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:41:45.210208 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Volume volume-183425a4-3857-401b-8f23-e0e83f107150 (183425a4-3857-401b-8f23-e0e83f107150): created successfully
Jul 16 21:41:45.214792 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62550df5-6e03-44b2-9395-49bea570bf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:41:45.221054 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Flow 'volume_create_manager' (99a04e52-f9cb-4460-8556-19ed0fa11a49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:41:45.301629 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-8cb7ac3c-bd78-4cbd-95c9-fb7073eceb1c tempest-TestVolumeBootPattern-1625426921 None] Created volume successfully.
Jul 16 21:41:50.281625 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-891df0cf-812f-4f81-80d6-383250e37051 req-62d60082-d65a-4ba2-ac7b-227f04c272a8 tempest-TestVolumeBootPattern-1625426921 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:41:51.372840 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-891df0cf-812f-4f81-80d6-383250e37051 req-62d60082-d65a-4ba2-ac7b-227f04c272a8 tempest-TestVolumeBootPattern-1625426921 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.091s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:41:51.374454 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-891df0cf-812f-4f81-80d6-383250e37051 req-62d60082-d65a-4ba2-ac7b-227f04c272a8 tempest-TestVolumeBootPattern-1625426921 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-183425a4-3857-401b-8f23-e0e83f107150', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '183425a4-3857-401b-8f23-e0e83f107150', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:41:51.535139 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-891df0cf-812f-4f81-80d6-383250e37051 req-62d60082-d65a-4ba2-ac7b-227f04c272a8 tempest-TestVolumeBootPattern-1625426921 None] Connection info returned from driver {'name': 'volumes/volume-183425a4-3857-401b-8f23-e0e83f107150', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '183425a4-3857-401b-8f23-e0e83f107150', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fdcf6e86-050c-4fa5-b48c-f0b3542f0b3b'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:41:51.847820 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-891df0cf-812f-4f81-80d6-383250e37051 req-62d60082-d65a-4ba2-ac7b-227f04c272a8 tempest-TestVolumeBootPattern-1625426921 None] attachment_update completed successfully.
Jul 16 21:41:53.164916 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=56,cinder:UPDATE=16,cinder:INSERT=7 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:41:53.319418 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-49f82618-add6-4b1f-8a3a-8dec7622e31c tempest-VolumesSnapshotTestJSON-1954720325 None] Created reservations ['1753cdf1-e0f7-4bd3-bee7-df15f7958819', '334aa113-b0ec-4b4f-a06e-607f84e31f21', '26991c11-1543-4927-bfdd-bcd90e462101', '0c78cfbb-e750-49d1-b8d2-20d8ea125e82'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:41:53.508034 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-49f82618-add6-4b1f-8a3a-8dec7622e31c tempest-VolumesSnapshotTestJSON-1954720325 None] Delete snapshot completed successfully.
Jul 16 21:41:53.519927 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-49f82618-add6-4b1f-8a3a-8dec7622e31c tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-8a0f87a1-64bc-4b63-ab20-6c969d99e3de-delete_snapshot" released by "delete_snapshot" :: held 31.261s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:41:53.585692 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f1aca837-d361-452a-a86e-d553597436d6 tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-b772228d-103f-4920-9b41-a24f53c7b0d8-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:41:53.599349 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f1aca837-d361-452a-a86e-d553597436d6 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-b772228d-103f-4920-9b41-a24f53c7b0d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:41:53.614367 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f1aca837-d361-452a-a86e-d553597436d6 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:41:56.968006 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-c7abdf89-cdad-4714-adaf-33bd566f0005 tempest-VolumesActionsTest-484965280 None] Uploaded volume to glance image-id: bf377075-6b16-46c2-942c-b7ce1e8f346e. {{(pid=131857) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1751}}
Jul 16 21:41:57.066663 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-c7abdf89-cdad-4714-adaf-33bd566f0005 tempest-VolumesActionsTest-484965280 None] Copy volume to image completed successfully.
Jul 16 21:41:59.608307 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-af592550-0fd8-4962-82bb-1779bd2ac27b tempest-VolumesActionsTest-484965280 None] Acquiring lock "cinder-ff4ded37-e86a-4e75-a728-854bffc880e8-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:41:59.619971 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-af592550-0fd8-4962-82bb-1779bd2ac27b tempest-VolumesActionsTest-484965280 None] Lock "cinder-ff4ded37-e86a-4e75-a728-854bffc880e8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:41:59.790466 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-af592550-0fd8-4962-82bb-1779bd2ac27b tempest-VolumesActionsTest-484965280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:41:59.991552 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-af592550-0fd8-4962-82bb-1779bd2ac27b tempest-VolumesActionsTest-484965280 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:41:59.992004 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-af592550-0fd8-4962-82bb-1779bd2ac27b tempest-VolumesActionsTest-484965280 None] Volume volume-ff4ded37-e86a-4e75-a728-854bffc880e8 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:42:00.141125 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-af592550-0fd8-4962-82bb-1779bd2ac27b tempest-VolumesActionsTest-484965280 None] deleting rbd volume volume-ff4ded37-e86a-4e75-a728-854bffc880e8 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:42:05.186851 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-af592550-0fd8-4962-82bb-1779bd2ac27b tempest-VolumesActionsTest-484965280 None] Created reservations ['a3acb910-61a8-4f62-a6d5-df49fe2feb32', '754ac588-74b9-48e6-bf35-2f47c1543187', 'df7bbf81-f9f4-4162-87b8-47a1191e1625', '2978e42f-122a-4222-af53-41920c0700f1'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:42:05.410710 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-af592550-0fd8-4962-82bb-1779bd2ac27b tempest-VolumesActionsTest-484965280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:42:05.463094 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-af592550-0fd8-4962-82bb-1779bd2ac27b tempest-VolumesActionsTest-484965280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:42:05.529062 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-af592550-0fd8-4962-82bb-1779bd2ac27b tempest-VolumesActionsTest-484965280 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:42:05.535126 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-af592550-0fd8-4962-82bb-1779bd2ac27b tempest-VolumesActionsTest-484965280 None] Deleted volume successfully.
Jul 16 21:42:05.620701 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-af592550-0fd8-4962-82bb-1779bd2ac27b tempest-VolumesActionsTest-484965280 None] Lock "cinder-ff4ded37-e86a-4e75-a728-854bffc880e8-delete_volume" released by "delete_volume" :: held 6.001s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:42:15.328272 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=22,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:42:22.841206 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=54,cinder:INSERT=14,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:42:25.135335 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-f1aca837-d361-452a-a86e-d553597436d6 tempest-VolumesSnapshotTestJSON-1954720325 None] Created reservations ['8461b675-3280-4938-b89c-aa827593d128', '4d4d1f9b-a824-4e87-8fb8-9d512c29b21e', '2916df7f-c4e5-49ff-9685-5786998165fb', '01eb9de7-c3a4-49bc-b752-c7fe48f00858'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:42:25.346732 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f1aca837-d361-452a-a86e-d553597436d6 tempest-VolumesSnapshotTestJSON-1954720325 None] Delete snapshot completed successfully.
Jul 16 21:42:25.353629 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f1aca837-d361-452a-a86e-d553597436d6 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-b772228d-103f-4920-9b41-a24f53c7b0d8-delete_snapshot" released by "delete_snapshot" :: held 31.753s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:42:25.841590 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-86a9ce6a-150c-4ad9-b1a8-b7b2b6d88185 tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-3ded575e-6a0d-4b12-8699-06f50ba5a73d-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:42:25.860054 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-86a9ce6a-150c-4ad9-b1a8-b7b2b6d88185 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-3ded575e-6a0d-4b12-8699-06f50ba5a73d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:42:25.862080 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-86a9ce6a-150c-4ad9-b1a8-b7b2b6d88185 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:42:38.420266 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:42:38.421043 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:42:38.444438 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:42:38.528926 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:42:52.849145 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=10,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:42:56.760600 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=20,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:42:56.877912 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-86a9ce6a-150c-4ad9-b1a8-b7b2b6d88185 tempest-VolumesSnapshotTestJSON-1954720325 None] Created reservations ['ec543d83-6475-421d-b641-3abf0f7de998', 'd7543a83-697a-4a5b-bc55-dcaac7019d84', 'a831501a-dea8-49f0-ba4b-117f23c21d8b', 'f2cdd6bf-891e-49fd-810c-6e62914e946c'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:42:57.019743 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-86a9ce6a-150c-4ad9-b1a8-b7b2b6d88185 tempest-VolumesSnapshotTestJSON-1954720325 None] Delete snapshot completed successfully.
Jul 16 21:42:57.025142 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-86a9ce6a-150c-4ad9-b1a8-b7b2b6d88185 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-3ded575e-6a0d-4b12-8699-06f50ba5a73d-delete_snapshot" released by "delete_snapshot" :: held 31.165s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:42:58.987976 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-16ba8be2-64e9-4bdf-98ba-860ab48fd4d1 req-4666ec6d-56d9-4d98-b222-ca3050376927 tempest-VolumesSnapshotTestJSON-1954720325 None] Terminate volume connection completed successfully.
Jul 16 21:42:58.988778 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-16ba8be2-64e9-4bdf-98ba-860ab48fd4d1 req-4666ec6d-56d9-4d98-b222-ca3050376927 tempest-VolumesSnapshotTestJSON-1954720325 None] Deleting attachment 3c40ce74-ad9a-4d5a-bb10-3555332bb911. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:43:04.159684 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:43:04.180077 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Flow 'volume_create_manager' (5d9645e1-3db8-4782-b260-b263a270b3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:43:04.186800 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ad5c7a-8326-4d26-b35f-b63694c144f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:04.205808 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ad5c7a-8326-4d26-b35f-b63694c144f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-330392573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e076f5bf-38c8-41ab-91a9-7d4fa7381380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56b8099d9406431284b4dd58b5c16359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:43:04Z,use_quota=True,user_id='95cd6b54d8164de1a524b407a1852ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:04.211160 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d0b702-e942-40b9-b661-86d89189e8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:04.216199 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d0b702-e942-40b9-b661-86d89189e8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:04.221882 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb26eec-a988-429f-a6a1-2b8a48f07932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:04.225993 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb26eec-a988-429f-a6a1-2b8a48f07932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e076f5bf-38c8-41ab-91a9-7d4fa7381380', 'volume_name': 'volume-e076f5bf-38c8-41ab-91a9-7d4fa7381380', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:04.231771 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6411e9-9bf7-40c5-9c5c-9135fe0e577b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:04.235739 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6411e9-9bf7-40c5-9c5c-9135fe0e577b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:04.240477 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3131adc-2702-4866-8d86-b905d1795190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:04.241561 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume e076f5bf-38c8-41ab-91a9-7d4fa7381380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e076f5bf-38c8-41ab-91a9-7d4fa7381380', 'volume_size': 1}
Jul 16 21:43:04.241964 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] creating volume 'volume-e076f5bf-38c8-41ab-91a9-7d4fa7381380' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:43:04.243070 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:04.916828 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:43:04.917580 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:43:04.922151 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3131adc-2702-4866-8d86-b905d1795190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e076f5bf-38c8-41ab-91a9-7d4fa7381380', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:04.926540 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50f6231-d4e8-488d-b3e3-6badce50b6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:05.009489 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume volume-e076f5bf-38c8-41ab-91a9-7d4fa7381380 (e076f5bf-38c8-41ab-91a9-7d4fa7381380): created successfully
Jul 16 21:43:05.013760 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50f6231-d4e8-488d-b3e3-6badce50b6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:05.023363 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Flow 'volume_create_manager' (5d9645e1-3db8-4782-b260-b263a270b3cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:43:05.096842 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-417ecd60-ebd4-4ca6-870e-230dbcdbd7c1 tempest-VolumesSnapshotTestJSON-1954720325 None] Created volume successfully.
Jul 16 21:43:06.841605 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-29d8069e-7306-405a-b285-35be3ea1be5a tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:10.409761 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-29d8069e-7306-405a-b285-35be3ea1be5a tempest-VolumesSnapshotTestJSON-1954720325 None] Create snapshot completed successfully
Jul 16 21:43:11.855998 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:43:11.887234 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Flow 'volume_create_manager' (6f061199-2f70-46f1-aeb6-10be1a848629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:43:11.894407 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b23f58-7934-41c1-bf91-b18e34464bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:11.910981 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b23f58-7934-41c1-bf91-b18e34464bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-28739418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ca543c7d-b55a-4740-8324-49ee0e5de097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56b8099d9406431284b4dd58b5c16359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:43:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3ff6d8f8-812e-47ae-89ad-cab154d8776c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:43:12Z,use_quota=True,user_id='95cd6b54d8164de1a524b407a1852ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:11.916992 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2515b981-d93f-4431-9de7-fc32c65d8d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:11.924347 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2515b981-d93f-4431-9de7-fc32c65d8d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:11.929549 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a0ec01-12d6-4276-9207-5f2ba271198d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:11.934096 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a0ec01-12d6-4276-9207-5f2ba271198d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca543c7d-b55a-4740-8324-49ee0e5de097', 'volume_name': 'volume-ca543c7d-b55a-4740-8324-49ee0e5de097', 'volume_size': 2, 'snapshot_id': '3ff6d8f8-812e-47ae-89ad-cab154d8776c'}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:11.938875 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fac8ed-02dd-4973-931f-dc3d1377be9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:11.942855 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fac8ed-02dd-4973-931f-dc3d1377be9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:11.948458 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e5d0a8-8592-402b-b694-13330cc40762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:11.949899 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume ca543c7d-b55a-4740-8324-49ee0e5de097: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca543c7d-b55a-4740-8324-49ee0e5de097', 'volume_size': 2, 'snapshot_id': '3ff6d8f8-812e-47ae-89ad-cab154d8776c'}
Jul 16 21:43:11.970952 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] cloning volumes/volume-e076f5bf-38c8-41ab-91a9-7d4fa7381380@snapshot-3ff6d8f8-812e-47ae-89ad-cab154d8776c to volume-ca543c7d-b55a-4740-8324-49ee0e5de097 {{(pid=131857) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}}
Jul 16 21:43:11.972851 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:12.024686 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:13.487929 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:43:13.488574 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:43:13.492852 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:15.089347 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e5d0a8-8592-402b-b694-13330cc40762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca543c7d-b55a-4740-8324-49ee0e5de097', 'volume_size': 2, 'snapshot_id': '3ff6d8f8-812e-47ae-89ad-cab154d8776c'}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:15.095434 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b62404a-c672-4088-beaf-b8d74a114d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:15.191345 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume volume-ca543c7d-b55a-4740-8324-49ee0e5de097 (ca543c7d-b55a-4740-8324-49ee0e5de097): created successfully
Jul 16 21:43:15.195357 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b62404a-c672-4088-beaf-b8d74a114d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:15.201529 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Flow 'volume_create_manager' (6f061199-2f70-46f1-aeb6-10be1a848629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:43:15.335052 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-309fee23-1330-43a7-8ad4-f7c428aa2a72 tempest-VolumesSnapshotTestJSON-1954720325 None] Created volume successfully.
Jul 16 21:43:16.170066 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a3633c52-ea89-454f-be11-09550d39d53e tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-ca543c7d-b55a-4740-8324-49ee0e5de097-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:43:16.184287 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a3633c52-ea89-454f-be11-09550d39d53e tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-ca543c7d-b55a-4740-8324-49ee0e5de097-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:43:16.297212 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a3633c52-ea89-454f-be11-09550d39d53e tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:16.655783 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a3633c52-ea89-454f-be11-09550d39d53e tempest-VolumesSnapshotTestJSON-1954720325 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:43:16.951133 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a3633c52-ea89-454f-be11-09550d39d53e tempest-VolumesSnapshotTestJSON-1954720325 None] deleting rbd volume volume-ca543c7d-b55a-4740-8324-49ee0e5de097 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:43:23.337134 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=42,cinder:INSERT=4,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:43:23.450993 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-a3633c52-ea89-454f-be11-09550d39d53e tempest-VolumesSnapshotTestJSON-1954720325 None] Created reservations ['c27de06d-5b93-4dd2-bb9b-48b0aa728821', '4cca750a-087c-4d07-9cba-9e34026286a3', '5759d075-139c-44c3-9837-e25e8948df46', '501d5f0e-967a-47a6-b2e5-6014aa096779'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:43:23.696074 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a3633c52-ea89-454f-be11-09550d39d53e tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:23.742765 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a3633c52-ea89-454f-be11-09550d39d53e tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:23.796228 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-a3633c52-ea89-454f-be11-09550d39d53e tempest-VolumesSnapshotTestJSON-1954720325 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:43:23.808880 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-a3633c52-ea89-454f-be11-09550d39d53e tempest-VolumesSnapshotTestJSON-1954720325 None] Deleted volume successfully.
Jul 16 21:43:23.918630 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a3633c52-ea89-454f-be11-09550d39d53e tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-ca543c7d-b55a-4740-8324-49ee0e5de097-delete_volume" released by "delete_volume" :: held 7.735s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:43:24.907824 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:43:24.927696 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Flow 'volume_create_manager' (9f5a798c-d880-4506-8b51-4485adddd6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:43:24.935104 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052d0ce3-6038-4600-be9c-fef74d260be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:24.954375 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052d0ce3-6038-4600-be9c-fef74d260be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-798559380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=759b2030-1170-42b3-858b-84f6f63a9748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56b8099d9406431284b4dd58b5c16359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:43:25Z,use_quota=True,user_id='95cd6b54d8164de1a524b407a1852ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:24.960130 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2b76d8-e036-4271-98b5-f8f342af05c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:24.966556 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2b76d8-e036-4271-98b5-f8f342af05c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:24.972102 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf8b869e-6357-456b-9450-7d2042b4c391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:24.979925 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf8b869e-6357-456b-9450-7d2042b4c391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759b2030-1170-42b3-858b-84f6f63a9748', 'volume_name': 'volume-759b2030-1170-42b3-858b-84f6f63a9748', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:24.983832 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc26a2a-6d8e-4aa0-979a-322b79b2e029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:24.988088 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc26a2a-6d8e-4aa0-979a-322b79b2e029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:24.993731 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d4dd0b-88a1-47f8-a8fa-44250703285e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:24.995507 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume 759b2030-1170-42b3-858b-84f6f63a9748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759b2030-1170-42b3-858b-84f6f63a9748', 'volume_size': 1}
Jul 16 21:43:24.997251 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] creating volume 'volume-759b2030-1170-42b3-858b-84f6f63a9748' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:43:24.997251 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:25.820440 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:43:25.820440 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:43:25.838409 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d4dd0b-88a1-47f8-a8fa-44250703285e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759b2030-1170-42b3-858b-84f6f63a9748', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:25.852744 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fcb87a8-553a-4a16-9cc0-847c076fd9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:25.927301 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume volume-759b2030-1170-42b3-858b-84f6f63a9748 (759b2030-1170-42b3-858b-84f6f63a9748): created successfully
Jul 16 21:43:25.931919 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fcb87a8-553a-4a16-9cc0-847c076fd9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:25.938031 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Flow 'volume_create_manager' (9f5a798c-d880-4506-8b51-4485adddd6d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:43:26.018120 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-bd41d91c-ad30-43bb-998b-5316f3f3f0c0 tempest-VolumesSnapshotTestJSON-1954720325 None] Created volume successfully.
Jul 16 21:43:27.407484 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=27,cinder:SELECT=47,cinder:DELETE=2,cinder:INSERT=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:43:27.516611 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-56adb7a0-ea5b-4f8b-83f6-db8423522728 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:29.851182 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-6602c9fd-9040-4bb0-a340-d1140f46dd0a req-6eb2167d-4e6d-4547-ae66-541333d06dfd tempest-TaggedBootDevicesTest_v242-896656767 None] Terminate volume connection completed successfully.
Jul 16 21:43:29.851862 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-6602c9fd-9040-4bb0-a340-d1140f46dd0a req-6eb2167d-4e6d-4547-ae66-541333d06dfd tempest-TaggedBootDevicesTest_v242-896656767 None] Deleting attachment 1fcc5b3b-78e8-423c-83fb-c7909a8cb869. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:43:30.070438 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-6602c9fd-9040-4bb0-a340-d1140f46dd0a req-936d2e60-381d-40fc-9e74-95e1743e06a0 tempest-TaggedBootDevicesTest_v242-896656767 None] Terminate volume connection completed successfully.
Jul 16 21:43:30.071702 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-6602c9fd-9040-4bb0-a340-d1140f46dd0a req-936d2e60-381d-40fc-9e74-95e1743e06a0 tempest-TaggedBootDevicesTest_v242-896656767 None] Deleting attachment 09ae566c-5d70-49de-a3f7-90442985a5b5. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:43:30.299087 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-6602c9fd-9040-4bb0-a340-d1140f46dd0a req-44e060de-2be2-4f1b-a8d6-81fa396c36c2 tempest-TaggedBootDevicesTest_v242-896656767 None] Terminate volume connection completed successfully.
Jul 16 21:43:30.302716 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-6602c9fd-9040-4bb0-a340-d1140f46dd0a req-44e060de-2be2-4f1b-a8d6-81fa396c36c2 tempest-TaggedBootDevicesTest_v242-896656767 None] Deleting attachment a1f1d8c1-96b1-4770-849b-068587bd42ca. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:43:30.797319 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-56adb7a0-ea5b-4f8b-83f6-db8423522728 tempest-VolumesSnapshotTestJSON-1954720325 None] Create snapshot completed successfully
Jul 16 21:43:32.433939 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:43:32.461369 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Flow 'volume_create_manager' (589edc23-56f8-4dd0-9551-08f351cf8079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:43:32.468353 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58229530-ae37-4e09-85a1-f166404627e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:32.485635 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58229530-ae37-4e09-85a1-f166404627e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-955500729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=14210160-f5c3-47c3-beb9-a84c5f857545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56b8099d9406431284b4dd58b5c16359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ee9937ff-b823-4e0f-8186-37217cad3d5d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:43:32Z,use_quota=True,user_id='95cd6b54d8164de1a524b407a1852ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:32.490879 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8faf9116-4be3-4458-9033-1779990ddcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:32.494942 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8faf9116-4be3-4458-9033-1779990ddcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:32.499899 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fa6731-e635-4567-beaa-934c725d99e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:32.503831 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fa6731-e635-4567-beaa-934c725d99e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '14210160-f5c3-47c3-beb9-a84c5f857545', 'volume_name': 'volume-14210160-f5c3-47c3-beb9-a84c5f857545', 'volume_size': 1, 'snapshot_id': 'ee9937ff-b823-4e0f-8186-37217cad3d5d'}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:32.508594 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35e2d77-93d2-4e16-9ad8-fe9c1e1a881a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:32.512432 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35e2d77-93d2-4e16-9ad8-fe9c1e1a881a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:32.517500 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4496187-a09a-4f4e-b290-b42035f2f048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:32.520484 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume 14210160-f5c3-47c3-beb9-a84c5f857545: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-14210160-f5c3-47c3-beb9-a84c5f857545', 'volume_size': 1, 'snapshot_id': 'ee9937ff-b823-4e0f-8186-37217cad3d5d'}
Jul 16 21:43:32.537847 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] cloning volumes/volume-759b2030-1170-42b3-858b-84f6f63a9748@snapshot-ee9937ff-b823-4e0f-8186-37217cad3d5d to volume-14210160-f5c3-47c3-beb9-a84c5f857545 {{(pid=131857) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}}
Jul 16 21:43:32.538536 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:32.581834 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:33.838274 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:43:33.839813 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:43:33.861130 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4496187-a09a-4f4e-b290-b42035f2f048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14210160-f5c3-47c3-beb9-a84c5f857545', 'volume_size': 1, 'snapshot_id': 'ee9937ff-b823-4e0f-8186-37217cad3d5d'}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:33.866035 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfa9c6d-69c3-44cc-8c75-8703d315f838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:43:33.968542 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume volume-14210160-f5c3-47c3-beb9-a84c5f857545 (14210160-f5c3-47c3-beb9-a84c5f857545): created successfully
Jul 16 21:43:33.974466 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfa9c6d-69c3-44cc-8c75-8703d315f838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:43:33.982783 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Flow 'volume_create_manager' (589edc23-56f8-4dd0-9551-08f351cf8079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:43:34.113580 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-5da852bf-5a0e-4715-95f5-aa46a21ec942 tempest-VolumesSnapshotTestJSON-1954720325 None] Created volume successfully.
Jul 16 21:43:34.616350 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9509c66c-3ab3-4f98-974a-9b7c22070a70 tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-14210160-f5c3-47c3-beb9-a84c5f857545-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:43:34.632175 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9509c66c-3ab3-4f98-974a-9b7c22070a70 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-14210160-f5c3-47c3-beb9-a84c5f857545-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:43:34.765844 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9509c66c-3ab3-4f98-974a-9b7c22070a70 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:34.974456 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9509c66c-3ab3-4f98-974a-9b7c22070a70 tempest-VolumesSnapshotTestJSON-1954720325 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:43:35.153614 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9509c66c-3ab3-4f98-974a-9b7c22070a70 tempest-VolumesSnapshotTestJSON-1954720325 None] deleting rbd volume volume-14210160-f5c3-47c3-beb9-a84c5f857545 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:43:35.781176 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f6463d45-bfb2-41a4-b4ab-ad7e34cb368c tempest-TaggedBootDevicesTest_v242-896656767 None] Acquiring lock "cinder-35056502-3c4b-4440-9da4-2bbf9347f08f-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:43:35.793540 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f6463d45-bfb2-41a4-b4ab-ad7e34cb368c tempest-TaggedBootDevicesTest_v242-896656767 None] Lock "cinder-35056502-3c4b-4440-9da4-2bbf9347f08f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:43:35.895476 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f6463d45-bfb2-41a4-b4ab-ad7e34cb368c tempest-TaggedBootDevicesTest_v242-896656767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:36.162959 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f6463d45-bfb2-41a4-b4ab-ad7e34cb368c tempest-TaggedBootDevicesTest_v242-896656767 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:43:36.163561 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f6463d45-bfb2-41a4-b4ab-ad7e34cb368c tempest-TaggedBootDevicesTest_v242-896656767 None] Volume volume-35056502-3c4b-4440-9da4-2bbf9347f08f is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:43:36.345587 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f6463d45-bfb2-41a4-b4ab-ad7e34cb368c tempest-TaggedBootDevicesTest_v242-896656767 None] deleting rbd volume volume-35056502-3c4b-4440-9da4-2bbf9347f08f {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:43:38.423951 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:43:38.424619 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:38.446438 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:38.477161 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:43:40.290098 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-9509c66c-3ab3-4f98-974a-9b7c22070a70 tempest-VolumesSnapshotTestJSON-1954720325 None] Created reservations ['6747d3fb-9d48-478c-a01f-908a8d78904c', '2896fcd3-9012-483a-8b3e-4fd7285a11e6', '925069e5-279c-4f39-b496-8040bd8b1f44', 'c96e1a6a-0cae-4ad0-a915-8a45b067b4ce'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:43:40.472857 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9509c66c-3ab3-4f98-974a-9b7c22070a70 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:40.592930 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9509c66c-3ab3-4f98-974a-9b7c22070a70 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:40.621297 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-9509c66c-3ab3-4f98-974a-9b7c22070a70 tempest-VolumesSnapshotTestJSON-1954720325 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:43:40.646335 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-9509c66c-3ab3-4f98-974a-9b7c22070a70 tempest-VolumesSnapshotTestJSON-1954720325 None] Deleted volume successfully.
Jul 16 21:43:40.741315 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9509c66c-3ab3-4f98-974a-9b7c22070a70 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-14210160-f5c3-47c3-beb9-a84c5f857545-delete_volume" released by "delete_volume" :: held 6.113s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:43:41.060682 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-f6463d45-bfb2-41a4-b4ab-ad7e34cb368c tempest-TaggedBootDevicesTest_v242-896656767 None] Created reservations ['87f19bf3-998e-4841-ba73-ef4ac0226806', '804110ab-593e-4f7d-bc16-5426ecf16861', '00038bf1-be5f-4b97-97a3-c6e1bcf2178b', '552b05e0-42bb-4bc4-9008-4ca734ac11b9'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:43:41.093306 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-1c734805-8566-4092-95af-a408f0316fa5 tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-ee9937ff-b823-4e0f-8186-37217cad3d5d-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:43:41.105593 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-1c734805-8566-4092-95af-a408f0316fa5 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-ee9937ff-b823-4e0f-8186-37217cad3d5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:43:41.108802 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1c734805-8566-4092-95af-a408f0316fa5 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:41.472052 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f6463d45-bfb2-41a4-b4ab-ad7e34cb368c tempest-TaggedBootDevicesTest_v242-896656767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:41.494744 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f6463d45-bfb2-41a4-b4ab-ad7e34cb368c tempest-TaggedBootDevicesTest_v242-896656767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:41.517904 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-f6463d45-bfb2-41a4-b4ab-ad7e34cb368c tempest-TaggedBootDevicesTest_v242-896656767 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:43:41.521957 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f6463d45-bfb2-41a4-b4ab-ad7e34cb368c tempest-TaggedBootDevicesTest_v242-896656767 None] Deleted volume successfully.
Jul 16 21:43:41.653895 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f6463d45-bfb2-41a4-b4ab-ad7e34cb368c tempest-TaggedBootDevicesTest_v242-896656767 None] Lock "cinder-35056502-3c4b-4440-9da4-2bbf9347f08f-delete_volume" released by "delete_volume" :: held 5.860s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:43:42.384203 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b502bf6a-3065-4d42-82d9-474be7f16c06 tempest-TaggedBootDevicesTest_v242-896656767 None] Acquiring lock "cinder-c4869fe9-11ee-40cf-8401-386b1a3bec57-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:43:42.398930 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b502bf6a-3065-4d42-82d9-474be7f16c06 tempest-TaggedBootDevicesTest_v242-896656767 None] Lock "cinder-c4869fe9-11ee-40cf-8401-386b1a3bec57-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:43:42.537106 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b502bf6a-3065-4d42-82d9-474be7f16c06 tempest-TaggedBootDevicesTest_v242-896656767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:42.706352 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b502bf6a-3065-4d42-82d9-474be7f16c06 tempest-TaggedBootDevicesTest_v242-896656767 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:43:42.706899 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b502bf6a-3065-4d42-82d9-474be7f16c06 tempest-TaggedBootDevicesTest_v242-896656767 None] Volume volume-c4869fe9-11ee-40cf-8401-386b1a3bec57 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:43:42.838216 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b502bf6a-3065-4d42-82d9-474be7f16c06 tempest-TaggedBootDevicesTest_v242-896656767 None] deleting rbd volume volume-c4869fe9-11ee-40cf-8401-386b1a3bec57 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:43:44.190779 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-1c734805-8566-4092-95af-a408f0316fa5 tempest-VolumesSnapshotTestJSON-1954720325 None] Created reservations ['8ce6ca5a-f648-4eb7-9869-0e2428d685b6', 'f3208b79-b8ae-4111-a4f0-f79f38032577', 'eaa3d72f-8453-44a1-a15f-e8f606ba9a3c', '93449107-39ba-493b-8a90-a19943087164'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:43:44.388876 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=70,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:43:44.477755 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-1c734805-8566-4092-95af-a408f0316fa5 tempest-VolumesSnapshotTestJSON-1954720325 None] Delete snapshot completed successfully.
Jul 16 21:43:44.483353 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-1c734805-8566-4092-95af-a408f0316fa5 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-ee9937ff-b823-4e0f-8186-37217cad3d5d-delete_snapshot" released by "delete_snapshot" :: held 3.378s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:43:45.528521 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-cb6a7cde-8b2a-4cbf-a0d0-46f10ba66419 tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-759b2030-1170-42b3-858b-84f6f63a9748-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:43:45.537496 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-cb6a7cde-8b2a-4cbf-a0d0-46f10ba66419 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-759b2030-1170-42b3-858b-84f6f63a9748-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:43:45.687078 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cb6a7cde-8b2a-4cbf-a0d0-46f10ba66419 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:45.888543 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cb6a7cde-8b2a-4cbf-a0d0-46f10ba66419 tempest-VolumesSnapshotTestJSON-1954720325 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:43:45.889096 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cb6a7cde-8b2a-4cbf-a0d0-46f10ba66419 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume volume-759b2030-1170-42b3-858b-84f6f63a9748 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:43:46.043865 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cb6a7cde-8b2a-4cbf-a0d0-46f10ba66419 tempest-VolumesSnapshotTestJSON-1954720325 None] deleting rbd volume volume-759b2030-1170-42b3-858b-84f6f63a9748 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:43:47.783541 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=61,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=7 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:43:47.843451 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-b502bf6a-3065-4d42-82d9-474be7f16c06 tempest-TaggedBootDevicesTest_v242-896656767 None] Created reservations ['82cbdd49-be86-44e6-9727-df020e2aa9b7', '08e5ceba-7e84-4901-820f-278c95905ce5', 'c792f668-f4a5-4ca9-a058-270ce543d35e', '2afb9c5f-c78a-4a1b-bb38-ab068a5d8c7d'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:43:48.081463 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b502bf6a-3065-4d42-82d9-474be7f16c06 tempest-TaggedBootDevicesTest_v242-896656767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:48.101269 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b502bf6a-3065-4d42-82d9-474be7f16c06 tempest-TaggedBootDevicesTest_v242-896656767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:48.174763 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-b502bf6a-3065-4d42-82d9-474be7f16c06 tempest-TaggedBootDevicesTest_v242-896656767 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:43:48.178987 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b502bf6a-3065-4d42-82d9-474be7f16c06 tempest-TaggedBootDevicesTest_v242-896656767 None] Deleted volume successfully.
Jul 16 21:43:48.236313 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b502bf6a-3065-4d42-82d9-474be7f16c06 tempest-TaggedBootDevicesTest_v242-896656767 None] Lock "cinder-c4869fe9-11ee-40cf-8401-386b1a3bec57-delete_volume" released by "delete_volume" :: held 5.837s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:43:48.945870 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-961bcce5-dc76-4225-a122-955345abc100 tempest-TaggedBootDevicesTest_v242-896656767 None] Acquiring lock "cinder-048fbb68-c884-46b4-aa78-58477a185196-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:43:48.957490 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-961bcce5-dc76-4225-a122-955345abc100 tempest-TaggedBootDevicesTest_v242-896656767 None] Lock "cinder-048fbb68-c884-46b4-aa78-58477a185196-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:43:49.069188 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-961bcce5-dc76-4225-a122-955345abc100 tempest-TaggedBootDevicesTest_v242-896656767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:49.225743 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-961bcce5-dc76-4225-a122-955345abc100 tempest-TaggedBootDevicesTest_v242-896656767 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:43:49.416413 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-961bcce5-dc76-4225-a122-955345abc100 tempest-TaggedBootDevicesTest_v242-896656767 None] deleting rbd volume volume-048fbb68-c884-46b4-aa78-58477a185196 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:43:50.889562 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-cb6a7cde-8b2a-4cbf-a0d0-46f10ba66419 tempest-VolumesSnapshotTestJSON-1954720325 None] Created reservations ['f4582a6d-9fc3-4d82-8a52-5cd69c4980fc', 'a3123d17-2eca-44f7-8745-a5a9b7af1671', '12b14575-7d72-45ec-95d8-ff3191620972', '5c3d64c2-80e0-458b-8f23-f6301fcb3ef3'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:43:51.090732 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cb6a7cde-8b2a-4cbf-a0d0-46f10ba66419 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:51.126402 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cb6a7cde-8b2a-4cbf-a0d0-46f10ba66419 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:51.156282 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-cb6a7cde-8b2a-4cbf-a0d0-46f10ba66419 tempest-VolumesSnapshotTestJSON-1954720325 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:43:51.160246 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-cb6a7cde-8b2a-4cbf-a0d0-46f10ba66419 tempest-VolumesSnapshotTestJSON-1954720325 None] Deleted volume successfully.
Jul 16 21:43:51.250000 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-cb6a7cde-8b2a-4cbf-a0d0-46f10ba66419 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-759b2030-1170-42b3-858b-84f6f63a9748-delete_volume" released by "delete_volume" :: held 5.712s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:43:52.028349 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b87c67d6-fc01-4597-8eac-2265aef3f4b8 tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-3ff6d8f8-812e-47ae-89ad-cab154d8776c-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:43:52.042854 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b87c67d6-fc01-4597-8eac-2265aef3f4b8 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-3ff6d8f8-812e-47ae-89ad-cab154d8776c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:43:52.050466 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b87c67d6-fc01-4597-8eac-2265aef3f4b8 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:55.571348 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-961bcce5-dc76-4225-a122-955345abc100 tempest-TaggedBootDevicesTest_v242-896656767 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:43:55.839224 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-961bcce5-dc76-4225-a122-955345abc100 tempest-TaggedBootDevicesTest_v242-896656767 None] deleting parent snapshot volume-048fbb68-c884-46b4-aa78-58477a185196.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:43:58.803735 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-b87c67d6-fc01-4597-8eac-2265aef3f4b8 tempest-VolumesSnapshotTestJSON-1954720325 None] Created reservations ['b2a48cd7-566d-4325-96b0-398bf20e6852', 'ccec0a03-425f-44c4-8b8d-d34a24c458c2', '1761def7-9b49-4765-a929-a644d349327a', 'a4e5db46-075b-4a65-944c-1425548bff58'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:43:58.865843 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-961bcce5-dc76-4225-a122-955345abc100 tempest-TaggedBootDevicesTest_v242-896656767 None] Created reservations ['1c244247-8fab-4790-a87d-0c57690f216f', 'bee9fa56-1f21-4ab9-a976-f156dffe3d1a', '215306c6-5a7b-4237-9f3a-750b8503197a', '0b88ea99-f411-4aa2-8f72-555db5a69b1d'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:43:59.052640 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b87c67d6-fc01-4597-8eac-2265aef3f4b8 tempest-VolumesSnapshotTestJSON-1954720325 None] Delete snapshot completed successfully.
Jul 16 21:43:59.060588 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b87c67d6-fc01-4597-8eac-2265aef3f4b8 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-3ff6d8f8-812e-47ae-89ad-cab154d8776c-delete_snapshot" released by "delete_snapshot" :: held 7.018s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:43:59.101101 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-961bcce5-dc76-4225-a122-955345abc100 tempest-TaggedBootDevicesTest_v242-896656767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:59.139816 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-961bcce5-dc76-4225-a122-955345abc100 tempest-TaggedBootDevicesTest_v242-896656767 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:59.170831 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-961bcce5-dc76-4225-a122-955345abc100 tempest-TaggedBootDevicesTest_v242-896656767 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:43:59.175841 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-961bcce5-dc76-4225-a122-955345abc100 tempest-TaggedBootDevicesTest_v242-896656767 None] Deleted volume successfully.
Jul 16 21:43:59.326817 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-961bcce5-dc76-4225-a122-955345abc100 tempest-TaggedBootDevicesTest_v242-896656767 None] Lock "cinder-048fbb68-c884-46b4-aa78-58477a185196-delete_volume" released by "delete_volume" :: held 10.369s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:43:59.523140 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-044990e3-62e1-44af-84ce-d46fdd75b383 tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-e076f5bf-38c8-41ab-91a9-7d4fa7381380-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:43:59.531325 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-044990e3-62e1-44af-84ce-d46fdd75b383 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-e076f5bf-38c8-41ab-91a9-7d4fa7381380-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:43:59.648542 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-044990e3-62e1-44af-84ce-d46fdd75b383 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:43:59.827189 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-044990e3-62e1-44af-84ce-d46fdd75b383 tempest-VolumesSnapshotTestJSON-1954720325 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:43:59.828302 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-044990e3-62e1-44af-84ce-d46fdd75b383 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume volume-e076f5bf-38c8-41ab-91a9-7d4fa7381380 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:44:00.026640 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-044990e3-62e1-44af-84ce-d46fdd75b383 tempest-VolumesSnapshotTestJSON-1954720325 None] deleting rbd volume volume-e076f5bf-38c8-41ab-91a9-7d4fa7381380 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:44:05.633908 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-044990e3-62e1-44af-84ce-d46fdd75b383 tempest-VolumesSnapshotTestJSON-1954720325 None] Created reservations ['5e3654a0-76bc-4793-a4b5-5c59c0f946fb', 'e6a35f21-0a7d-4074-a9f1-594cf1af0242', '657e2298-134f-4617-bcec-b6d6925b31d3', '2b669b9e-092b-466b-9505-572f16a9709f'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:44:05.779039 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=50,cinder:UPDATE=38,cinder:INSERT=11,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:44:05.895450 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-044990e3-62e1-44af-84ce-d46fdd75b383 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:44:05.959850 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-044990e3-62e1-44af-84ce-d46fdd75b383 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:44:06.044915 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-044990e3-62e1-44af-84ce-d46fdd75b383 tempest-VolumesSnapshotTestJSON-1954720325 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:44:06.044915 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-044990e3-62e1-44af-84ce-d46fdd75b383 tempest-VolumesSnapshotTestJSON-1954720325 None] Deleted volume successfully.
Jul 16 21:44:06.045950 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:DELETE=3,cinder:SELECT=50,cinder:UPDATE=38,cinder:INSERT=9 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:44:06.114887 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-044990e3-62e1-44af-84ce-d46fdd75b383 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-e076f5bf-38c8-41ab-91a9-7d4fa7381380-delete_volume" released by "delete_volume" :: held 6.584s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:44:06.427618 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-6dd1ad5d-3c5d-4ffa-b594-4148aac40f3a tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-cf391899-1c79-49a5-8aea-2e9463b0c6f8-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:44:06.440815 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-6dd1ad5d-3c5d-4ffa-b594-4148aac40f3a tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-cf391899-1c79-49a5-8aea-2e9463b0c6f8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:44:06.550033 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6dd1ad5d-3c5d-4ffa-b594-4148aac40f3a tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:44:06.722800 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6dd1ad5d-3c5d-4ffa-b594-4148aac40f3a tempest-VolumesSnapshotTestJSON-1954720325 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:44:06.817022 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6dd1ad5d-3c5d-4ffa-b594-4148aac40f3a tempest-VolumesSnapshotTestJSON-1954720325 None] deleting rbd volume volume-cf391899-1c79-49a5-8aea-2e9463b0c6f8 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:44:11.953156 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6dd1ad5d-3c5d-4ffa-b594-4148aac40f3a tempest-VolumesSnapshotTestJSON-1954720325 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:44:12.187427 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6dd1ad5d-3c5d-4ffa-b594-4148aac40f3a tempest-VolumesSnapshotTestJSON-1954720325 None] deleting parent snapshot volume-cf391899-1c79-49a5-8aea-2e9463b0c6f8.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:44:14.718945 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-6dd1ad5d-3c5d-4ffa-b594-4148aac40f3a tempest-VolumesSnapshotTestJSON-1954720325 None] Created reservations ['d03ae3f2-fdd5-4773-9455-6d38ed9fbbe4', '43c2edb8-f7d7-4305-9c01-618084c05a8b', '41fdc887-beae-4d24-b7bf-6116b5453ef6', '321d4f07-9249-4da6-8ee3-7b5c19a7758e'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:44:14.945398 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6dd1ad5d-3c5d-4ffa-b594-4148aac40f3a tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:44:15.009357 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6dd1ad5d-3c5d-4ffa-b594-4148aac40f3a tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:44:15.143668 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-6dd1ad5d-3c5d-4ffa-b594-4148aac40f3a tempest-VolumesSnapshotTestJSON-1954720325 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:44:15.148034 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-6dd1ad5d-3c5d-4ffa-b594-4148aac40f3a tempest-VolumesSnapshotTestJSON-1954720325 None] Deleted volume successfully.
Jul 16 21:44:15.175289 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-608f7eab-255b-4f70-ba2c-127b31b10880 tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-cab71f74-7ac8-4e50-9f1a-f2123f3767a2-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:44:15.203248 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-608f7eab-255b-4f70-ba2c-127b31b10880 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-cab71f74-7ac8-4e50-9f1a-f2123f3767a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:44:15.205523 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-608f7eab-255b-4f70-ba2c-127b31b10880 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:44:15.575718 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-6dd1ad5d-3c5d-4ffa-b594-4148aac40f3a tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-cf391899-1c79-49a5-8aea-2e9463b0c6f8-delete_volume" released by "delete_volume" :: held 9.131s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:44:19.129176 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-608f7eab-255b-4f70-ba2c-127b31b10880 tempest-VolumesSnapshotTestJSON-1954720325 None] Created reservations ['1448686f-45be-4d99-873e-c87267728977', '26274be3-9d4c-45e0-92f1-bcd5831f45b1', 'f4ccf251-5608-46a5-b17f-6d4f07f2fb4e', 'a870efd8-e37d-495a-98ae-7a477641f063'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:44:19.333367 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-608f7eab-255b-4f70-ba2c-127b31b10880 tempest-VolumesSnapshotTestJSON-1954720325 None] Delete snapshot completed successfully.
Jul 16 21:44:19.339311 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-608f7eab-255b-4f70-ba2c-127b31b10880 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-cab71f74-7ac8-4e50-9f1a-f2123f3767a2-delete_snapshot" released by "delete_snapshot" :: held 4.140s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:44:19.645491 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9988bd3d-0ac4-4eea-babb-34a1d9f34679 tempest-VolumesSnapshotTestJSON-1954720325 None] Acquiring lock "cinder-f4e6fb31-921e-4c81-bf9b-833752a58dfc-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:44:19.656132 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9988bd3d-0ac4-4eea-babb-34a1d9f34679 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-f4e6fb31-921e-4c81-bf9b-833752a58dfc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:44:19.804279 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9988bd3d-0ac4-4eea-babb-34a1d9f34679 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:44:20.063971 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9988bd3d-0ac4-4eea-babb-34a1d9f34679 tempest-VolumesSnapshotTestJSON-1954720325 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:44:20.064293 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9988bd3d-0ac4-4eea-babb-34a1d9f34679 tempest-VolumesSnapshotTestJSON-1954720325 None] Volume volume-f4e6fb31-921e-4c81-bf9b-833752a58dfc is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:44:20.232541 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9988bd3d-0ac4-4eea-babb-34a1d9f34679 tempest-VolumesSnapshotTestJSON-1954720325 None] deleting rbd volume volume-f4e6fb31-921e-4c81-bf9b-833752a58dfc {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:44:20.519608 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:44:20.540357 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Flow 'volume_create_manager' (e763cf03-6e24-4325-ae57-2fc4e64808f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:44:20.547351 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32b6f4d-175a-4898-bb10-338a24aa0fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:44:20.567162 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32b6f4d-175a-4898-bb10-338a24aa0fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-719782006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=60fe0e37-1c20-4c04-a124-84e193cfdd27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f296b14a61a4997bf411c9b0fdc39d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:44:20Z,use_quota=True,user_id='001ed11a062a4cb08a52d1294ef5880b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:44:20.598172 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e23ea0-89c7-4f31-a505-acfcb13784bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:44:20.602488 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e23ea0-89c7-4f31-a505-acfcb13784bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:44:20.610644 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac5d622-57f6-4ba2-94d2-8ee59a84e0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:44:20.768410 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac5d622-57f6-4ba2-94d2-8ee59a84e0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '60fe0e37-1c20-4c04-a124-84e193cfdd27', 'volume_name': 'volume-60fe0e37-1c20-4c04-a124-84e193cfdd27', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f658c70>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:44:20.774034 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0f9c70-f9f8-47cf-a852-b4c10f973026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:44:20.778085 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0f9c70-f9f8-47cf-a852-b4c10f973026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:44:20.785242 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0d4234-f200-49a3-afb9-4ba327246448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:44:20.786850 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Volume 60fe0e37-1c20-4c04-a124-84e193cfdd27: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-60fe0e37-1c20-4c04-a124-84e193cfdd27', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f658c70>}
Jul 16 21:44:20.787650 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Cloning 60fe0e37-1c20-4c04-a124-84e193cfdd27 from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9  at location (None, None). {{(pid=131857) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Jul 16 21:44:20.788566 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Acquiring lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" by "_prepare_image_cache_entry" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:44:20.799754 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:44:20.870066 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 44, 20, 804401)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:44:20.870364 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:44:20.871548 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Found cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Jul 16 21:44:20.877763 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" released by "_prepare_image_cache_entry" :: held 0.078s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:44:20.879339 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Attempting to retrieve cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Jul 16 21:44:20.892502 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 44, 20, 886543)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:44:20.893128 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:44:20.893539 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Creating from source image-volume b59b3901-b32a-4d92-81b0-6b99e88e4517 {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Jul 16 21:44:20.910265 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:44:21.248995 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] creating snapshot='volume-60fe0e37-1c20-4c04-a124-84e193cfdd27.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:44:24.255730 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] cloning 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517@volume-60fe0e37-1c20-4c04-a124-84e193cfdd27.clone_snap' to 'volume-60fe0e37-1c20-4c04-a124-84e193cfdd27' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:44:26.146611 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945.deleted is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:44:26.154041 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:44:26.154041 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:44:26.666007 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:44:26.667155 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Marking volume 60fe0e37-1c20-4c04-a124-84e193cfdd27 as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:44:26.762296 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Copying metadata from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 to 60fe0e37-1c20-4c04-a124-84e193cfdd27. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Jul 16 21:44:26.762296 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Creating volume glance metadata for volume 60fe0e37-1c20-4c04-a124-84e193cfdd27 backed by image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131857) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Jul 16 21:44:26.860471 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-9988bd3d-0ac4-4eea-babb-34a1d9f34679 tempest-VolumesSnapshotTestJSON-1954720325 None] Created reservations ['f2ec0894-0817-4fc9-b96f-d6845bdb0bc5', '9a31f9fb-eb8f-4cdc-af44-24ac56091713', 'af988c50-90c9-4ca3-82c4-8ceecf3c1569', '8ea8d349-a16c-4c20-a318-b28c01d975c8'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:44:26.933174 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0d4234-f200-49a3-afb9-4ba327246448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60fe0e37-1c20-4c04-a124-84e193cfdd27', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f658c70>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:44:26.938226 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e096c73-10a6-4890-91f9-73e0b2157a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:44:27.060495 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Volume volume-60fe0e37-1c20-4c04-a124-84e193cfdd27 (60fe0e37-1c20-4c04-a124-84e193cfdd27): created successfully
Jul 16 21:44:27.064754 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e096c73-10a6-4890-91f9-73e0b2157a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:44:27.070790 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Flow 'volume_create_manager' (e763cf03-6e24-4325-ae57-2fc4e64808f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:44:27.112355 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9988bd3d-0ac4-4eea-babb-34a1d9f34679 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:44:27.171311 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9988bd3d-0ac4-4eea-babb-34a1d9f34679 tempest-VolumesSnapshotTestJSON-1954720325 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:44:27.224738 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-9988bd3d-0ac4-4eea-babb-34a1d9f34679 tempest-VolumesSnapshotTestJSON-1954720325 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:44:27.236140 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-3d78dde5-d76f-404b-bfdd-89db185ceac3 tempest-TestVolumeBackupRestore-577066854 None] Created volume successfully.
Jul 16 21:44:27.236140 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-9988bd3d-0ac4-4eea-babb-34a1d9f34679 tempest-VolumesSnapshotTestJSON-1954720325 None] Deleted volume successfully.
Jul 16 21:44:27.377492 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9988bd3d-0ac4-4eea-babb-34a1d9f34679 tempest-VolumesSnapshotTestJSON-1954720325 None] Lock "cinder-f4e6fb31-921e-4c81-bf9b-833752a58dfc-delete_volume" released by "delete_volume" :: held 7.721s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:44:29.368374 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-bfab0606-f49c-4a71-a837-78502f28fa30 tempest-TestVolumeBackupRestore-577066854 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-07-16T21:44:28Z,data_timestamp=2022-07-16T21:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=3ebabd90-ade3-4b43-90dc-ef23ae73f9c8,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='8f296b14a61a4997bf411c9b0fdc39d5',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='001ed11a062a4cb08a52d1294ef5880b',volume_id=60fe0e37-1c20-4c04-a124-84e193cfdd27)
Jul 16 21:44:29.369201 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.backup.rpcapi [None req-bfab0606-f49c-4a71-a837-78502f28fa30 tempest-TestVolumeBackupRestore-577066854 None] continue_backup in rpcapi backup_id 3ebabd90-ade3-4b43-90dc-ef23ae73f9c8 {{(pid=131857) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Jul 16 21:44:29.588382 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-bfab0606-f49c-4a71-a837-78502f28fa30 tempest-TestVolumeBackupRestore-577066854 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:44:30.759904 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-bfab0606-f49c-4a71-a837-78502f28fa30 tempest-TestVolumeBackupRestore-577066854 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.171s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:44:30.760890 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bfab0606-f49c-4a71-a837-78502f28fa30 tempest-TestVolumeBackupRestore-577066854 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-60fe0e37-1c20-4c04-a124-84e193cfdd27', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '60fe0e37-1c20-4c04-a124-84e193cfdd27', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:44:30.786796 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-bfab0606-f49c-4a71-a837-78502f28fa30 tempest-TestVolumeBackupRestore-577066854 None] Initialize volume connection completed successfully.
Jul 16 21:44:38.424386 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:44:38.425862 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:44:38.480835 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:44:38.522930 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:44:40.785090 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=53,cinder:UPDATE=25,cinder:INSERT=14 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:44:44.584522 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=60,cinder:UPDATE=27,cinder:INSERT=10,cinder:DELETE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:45:13.610550 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-bfab0606-f49c-4a71-a837-78502f28fa30 tempest-TestVolumeBackupRestore-577066854 None] Terminate volume connection completed successfully.
Jul 16 21:45:13.635508 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:45:13.638791 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-bfab0606-f49c-4a71-a837-78502f28fa30 tempest-TestVolumeBackupRestore-577066854 None] Remove volume export completed successfully.
Jul 16 21:45:16.063229 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:45:16.108570 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Flow 'volume_create_manager' (030145a1-df33-4e2b-a28b-23249a9c3858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:45:16.121358 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa66eace-d476-483b-b566-90a615ffb46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:45:16.146539 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa66eace-d476-483b-b566-90a615ffb46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:45:15Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_3ebabd90-ade3-4b43-90dc-ef23ae73f9c8',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=34b057b6-39af-4a53-9a45-d9404aea035f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f296b14a61a4997bf411c9b0fdc39d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:45:16Z,use_quota=True,user_id='001ed11a062a4cb08a52d1294ef5880b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:45:16.152812 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9b11ac-71b2-42c0-a6db-ea4cf7e82058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:45:16.158201 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9b11ac-71b2-42c0-a6db-ea4cf7e82058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:45:16.164099 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc866fd-566d-4361-b727-bda70dde406a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:45:16.168907 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc866fd-566d-4361-b727-bda70dde406a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b057b6-39af-4a53-9a45-d9404aea035f', 'volume_name': 'volume-34b057b6-39af-4a53-9a45-d9404aea035f', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:45:16.181879 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c73cf3-63f1-47c2-9a24-025b34405155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:45:16.181879 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c73cf3-63f1-47c2-9a24-025b34405155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:45:16.183473 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49074e48-af86-484c-97d0-55cb7ce1c419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:45:16.184958 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Volume 34b057b6-39af-4a53-9a45-d9404aea035f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b057b6-39af-4a53-9a45-d9404aea035f', 'volume_size': 1}
Jul 16 21:45:16.184958 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] creating volume 'volume-34b057b6-39af-4a53-9a45-d9404aea035f' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:45:16.185684 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:45:17.018977 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:45:17.019418 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:45:17.023323 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49074e48-af86-484c-97d0-55cb7ce1c419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b057b6-39af-4a53-9a45-d9404aea035f', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:45:17.027943 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f20340-9849-480c-8f9e-f73205a7a414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:45:17.117388 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Volume volume-34b057b6-39af-4a53-9a45-d9404aea035f (34b057b6-39af-4a53-9a45-d9404aea035f): created successfully
Jul 16 21:45:17.122017 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f20340-9849-480c-8f9e-f73205a7a414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:45:17.128474 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Flow 'volume_create_manager' (030145a1-df33-4e2b-a28b-23249a9c3858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:45:17.260695 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Created volume successfully.
Jul 16 21:45:18.123640 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:45:19.021690 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.898s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:45:19.022512 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-34b057b6-39af-4a53-9a45-d9404aea035f', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '34b057b6-39af-4a53-9a45-d9404aea035f', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:45:19.042274 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Initialize volume connection completed successfully.
Jul 16 21:45:28.193170 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=17,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:45:28.196185 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-eaf555ee-4a42-49ce-a3ae-b102c8bf3b60 req-97960c84-4f71-4a07-9059-9604b8bcb9f8 tempest-TestVolumeBootPattern-1625426921 None] Terminate volume connection completed successfully.
Jul 16 21:45:28.196615 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-eaf555ee-4a42-49ce-a3ae-b102c8bf3b60 req-97960c84-4f71-4a07-9059-9604b8bcb9f8 tempest-TestVolumeBootPattern-1625426921 None] Deleting attachment fdcf6e86-050c-4fa5-b48c-f0b3542f0b3b. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:45:29.889657 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e433cde3-5dda-4538-92b7-7a594a0875be tempest-TestVolumeBootPattern-1625426921 None] Acquiring lock "cinder-183425a4-3857-401b-8f23-e0e83f107150-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:45:29.903068 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e433cde3-5dda-4538-92b7-7a594a0875be tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-183425a4-3857-401b-8f23-e0e83f107150-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:45:29.992308 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e433cde3-5dda-4538-92b7-7a594a0875be tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:45:30.625427 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e433cde3-5dda-4538-92b7-7a594a0875be tempest-TestVolumeBootPattern-1625426921 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:45:30.850088 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e433cde3-5dda-4538-92b7-7a594a0875be tempest-TestVolumeBootPattern-1625426921 None] deleting rbd volume volume-183425a4-3857-401b-8f23-e0e83f107150 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:45:38.420346 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:45:38.421078 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:45:38.443957 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:45:38.467063 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:45:38.781435 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e433cde3-5dda-4538-92b7-7a594a0875be tempest-TestVolumeBootPattern-1625426921 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:45:38.957773 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e433cde3-5dda-4538-92b7-7a594a0875be tempest-TestVolumeBootPattern-1625426921 None] deleting parent snapshot volume-183425a4-3857-401b-8f23-e0e83f107150.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:45:43.395270 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-e433cde3-5dda-4538-92b7-7a594a0875be tempest-TestVolumeBootPattern-1625426921 None] Created reservations ['377b35a2-5777-4162-8e05-2991dc2c8701', 'dc897216-403c-4b95-8618-f38983563f86', 'c552752d-968e-4abf-a0ed-61c38f9da764', '110fa4e2-1990-47f8-ac11-61a9919a60d0'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:45:43.574768 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e433cde3-5dda-4538-92b7-7a594a0875be tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:45:43.603962 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e433cde3-5dda-4538-92b7-7a594a0875be tempest-TestVolumeBootPattern-1625426921 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:45:43.630699 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-e433cde3-5dda-4538-92b7-7a594a0875be tempest-TestVolumeBootPattern-1625426921 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:45:43.634883 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e433cde3-5dda-4538-92b7-7a594a0875be tempest-TestVolumeBootPattern-1625426921 None] Deleted volume successfully.
Jul 16 21:45:43.708693 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e433cde3-5dda-4538-92b7-7a594a0875be tempest-TestVolumeBootPattern-1625426921 None] Lock "cinder-183425a4-3857-401b-8f23-e0e83f107150-delete_volume" released by "delete_volume" :: held 13.806s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:45:44.581502 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=13,cinder:SELECT=25,cinder:DELETE=1,cinder:INSERT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:45:52.453417 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:45:52.496481 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Flow 'volume_create_manager' (bcd8f79f-f54f-4b70-9d17-35ebbdd31d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:45:52.510401 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9979d072-5efb-441c-b6ae-cc45fae110b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:45:52.546805 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9979d072-5efb-441c-b6ae-cc45fae110b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-206314346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=29d846c4-eb90-4ff5-a11b-24a261dfb1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60c0863dc6f4313bdc873fda27ae2fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:45:52Z,use_quota=True,user_id='0ab8b3f06e994bbca5d6dd14109bfe50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:45:52.553443 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e9d268-5f73-4535-bc9a-3673200f63f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:45:52.557621 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e9d268-5f73-4535-bc9a-3673200f63f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:45:52.564202 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3900f343-fd44-4f7c-9429-53e997001514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:45:52.569022 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3900f343-fd44-4f7c-9429-53e997001514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d846c4-eb90-4ff5-a11b-24a261dfb1cc', 'volume_name': 'volume-29d846c4-eb90-4ff5-a11b-24a261dfb1cc', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:45:52.575037 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5777c90-da44-499b-bfda-8ea0d08cb343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:45:52.578989 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5777c90-da44-499b-bfda-8ea0d08cb343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:45:52.583795 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b267d3db-73ed-4f24-93e7-66155bc468ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:45:52.584911 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Volume 29d846c4-eb90-4ff5-a11b-24a261dfb1cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d846c4-eb90-4ff5-a11b-24a261dfb1cc', 'volume_size': 1}
Jul 16 21:45:52.588820 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] creating volume 'volume-29d846c4-eb90-4ff5-a11b-24a261dfb1cc' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:45:52.588820 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:45:53.445184 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:45:53.445781 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:45:53.453510 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b267d3db-73ed-4f24-93e7-66155bc468ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d846c4-eb90-4ff5-a11b-24a261dfb1cc', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:45:53.466553 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37aa509f-4f3b-4eb8-a39c-1afe02cff9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:45:53.606375 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Volume volume-29d846c4-eb90-4ff5-a11b-24a261dfb1cc (29d846c4-eb90-4ff5-a11b-24a261dfb1cc): created successfully
Jul 16 21:45:53.610022 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37aa509f-4f3b-4eb8-a39c-1afe02cff9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:45:53.616183 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Flow 'volume_create_manager' (bcd8f79f-f54f-4b70-9d17-35ebbdd31d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:45:53.733849 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-5dde7006-0ebf-4a3a-88fe-84699ee1c5ec tempest-AttachVolumeNegativeTest-17004004 None] Created volume successfully.
Jul 16 21:45:55.139292 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Terminate volume connection completed successfully.
Jul 16 21:45:55.165074 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f7fc814b-e5f8-46bc-a63c-35b01e05b24f tempest-TestVolumeBackupRestore-577066854 None] Remove volume export completed successfully.
Jul 16 21:45:55.571964 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-a43f242c-80b5-4d43-9255-83dbc67b01ad req-eb7eaae6-d589-4aa6-82da-07d1410b4015 tempest-AttachVolumeNegativeTest-17004004 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:45:56.467117 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-a43f242c-80b5-4d43-9255-83dbc67b01ad req-eb7eaae6-d589-4aa6-82da-07d1410b4015 tempest-AttachVolumeNegativeTest-17004004 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.895s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:45:56.468063 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-a43f242c-80b5-4d43-9255-83dbc67b01ad req-eb7eaae6-d589-4aa6-82da-07d1410b4015 tempest-AttachVolumeNegativeTest-17004004 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-29d846c4-eb90-4ff5-a11b-24a261dfb1cc', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '29d846c4-eb90-4ff5-a11b-24a261dfb1cc', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:45:56.574062 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-a43f242c-80b5-4d43-9255-83dbc67b01ad req-eb7eaae6-d589-4aa6-82da-07d1410b4015 tempest-AttachVolumeNegativeTest-17004004 None] Connection info returned from driver {'name': 'volumes/volume-29d846c4-eb90-4ff5-a11b-24a261dfb1cc', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '29d846c4-eb90-4ff5-a11b-24a261dfb1cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '70413de6-0a28-4a9a-a261-dce5e6bf758b'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:45:56.672612 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-a43f242c-80b5-4d43-9255-83dbc67b01ad req-eb7eaae6-d589-4aa6-82da-07d1410b4015 tempest-AttachVolumeNegativeTest-17004004 None] attachment_update completed successfully.
Jul 16 21:46:00.925402 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=36,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:46:00.929004 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-830c3473-c553-4893-9281-3473f03f9703 req-2fe5ba08-3b08-4925-8b6e-c58f890011a5 tempest-AttachVolumeNegativeTest-17004004 None] Terminate volume connection completed successfully.
Jul 16 21:46:00.929424 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-830c3473-c553-4893-9281-3473f03f9703 req-2fe5ba08-3b08-4925-8b6e-c58f890011a5 tempest-AttachVolumeNegativeTest-17004004 None] Deleting attachment 70413de6-0a28-4a9a-a261-dce5e6bf758b. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:46:04.711803 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-501d9f67-9f22-4c36-8150-38f04d69d8b8 req-2fcb4eaf-3cca-4409-9932-9aef87de60d0 tempest-TestVolumeBackupRestore-577066854 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:46:05.607325 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-501d9f67-9f22-4c36-8150-38f04d69d8b8 req-2fcb4eaf-3cca-4409-9932-9aef87de60d0 tempest-TestVolumeBackupRestore-577066854 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.895s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:46:05.608156 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-501d9f67-9f22-4c36-8150-38f04d69d8b8 req-2fcb4eaf-3cca-4409-9932-9aef87de60d0 tempest-TestVolumeBackupRestore-577066854 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-34b057b6-39af-4a53-9a45-d9404aea035f', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '34b057b6-39af-4a53-9a45-d9404aea035f', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:46:05.697649 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-501d9f67-9f22-4c36-8150-38f04d69d8b8 req-2fcb4eaf-3cca-4409-9932-9aef87de60d0 tempest-TestVolumeBackupRestore-577066854 None] Connection info returned from driver {'name': 'volumes/volume-34b057b6-39af-4a53-9a45-d9404aea035f', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '34b057b6-39af-4a53-9a45-d9404aea035f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '94ddb0bb-4ce9-4972-a08c-ca3c9a1d3244'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 21:46:05.825802 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-501d9f67-9f22-4c36-8150-38f04d69d8b8 req-2fcb4eaf-3cca-4409-9932-9aef87de60d0 tempest-TestVolumeBackupRestore-577066854 None] attachment_update completed successfully.
Jul 16 21:46:07.785561 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-268d6ff5-dabe-4f2a-ad20-bbc532e082de tempest-AttachVolumeNegativeTest-17004004 None] Acquiring lock "cinder-29d846c4-eb90-4ff5-a11b-24a261dfb1cc-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:46:07.796713 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-268d6ff5-dabe-4f2a-ad20-bbc532e082de tempest-AttachVolumeNegativeTest-17004004 None] Lock "cinder-29d846c4-eb90-4ff5-a11b-24a261dfb1cc-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:46:07.877729 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-268d6ff5-dabe-4f2a-ad20-bbc532e082de tempest-AttachVolumeNegativeTest-17004004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:46:07.961998 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-268d6ff5-dabe-4f2a-ad20-bbc532e082de tempest-AttachVolumeNegativeTest-17004004 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:46:07.962448 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-268d6ff5-dabe-4f2a-ad20-bbc532e082de tempest-AttachVolumeNegativeTest-17004004 None] Volume volume-29d846c4-eb90-4ff5-a11b-24a261dfb1cc is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:46:08.019819 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-268d6ff5-dabe-4f2a-ad20-bbc532e082de tempest-AttachVolumeNegativeTest-17004004 None] deleting rbd volume volume-29d846c4-eb90-4ff5-a11b-24a261dfb1cc {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:46:10.179579 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-268d6ff5-dabe-4f2a-ad20-bbc532e082de tempest-AttachVolumeNegativeTest-17004004 None] Created reservations ['06437a3e-914d-4d45-8974-3e6c82eecf26', 'b3f133a0-89bd-45b4-be57-4f836fbf6008', '91e387be-db7c-4c1d-9299-b7a974ee93c6', '9658de76-3f70-4e68-9c9f-c0a88a2db370'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:46:10.385531 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-268d6ff5-dabe-4f2a-ad20-bbc532e082de tempest-AttachVolumeNegativeTest-17004004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:46:10.409279 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-268d6ff5-dabe-4f2a-ad20-bbc532e082de tempest-AttachVolumeNegativeTest-17004004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:46:10.435704 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-268d6ff5-dabe-4f2a-ad20-bbc532e082de tempest-AttachVolumeNegativeTest-17004004 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:46:10.439754 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-268d6ff5-dabe-4f2a-ad20-bbc532e082de tempest-AttachVolumeNegativeTest-17004004 None] Deleted volume successfully.
Jul 16 21:46:10.514593 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-268d6ff5-dabe-4f2a-ad20-bbc532e082de tempest-AttachVolumeNegativeTest-17004004 None] Lock "cinder-29d846c4-eb90-4ff5-a11b-24a261dfb1cc-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:46:11.215151 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3c8d3943-a0fd-4e33-8167-5c4285eb13f3 tempest-AttachVolumeNegativeTest-17004004 None] Acquiring lock "cinder-0e8d79ef-dae3-4fef-bd30-da0b85b52de1-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:46:11.225294 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3c8d3943-a0fd-4e33-8167-5c4285eb13f3 tempest-AttachVolumeNegativeTest-17004004 None] Lock "cinder-0e8d79ef-dae3-4fef-bd30-da0b85b52de1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:46:11.311495 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3c8d3943-a0fd-4e33-8167-5c4285eb13f3 tempest-AttachVolumeNegativeTest-17004004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:46:11.396113 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3c8d3943-a0fd-4e33-8167-5c4285eb13f3 tempest-AttachVolumeNegativeTest-17004004 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:46:11.396533 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3c8d3943-a0fd-4e33-8167-5c4285eb13f3 tempest-AttachVolumeNegativeTest-17004004 None] Volume volume-0e8d79ef-dae3-4fef-bd30-da0b85b52de1 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:46:11.488534 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3c8d3943-a0fd-4e33-8167-5c4285eb13f3 tempest-AttachVolumeNegativeTest-17004004 None] deleting rbd volume volume-0e8d79ef-dae3-4fef-bd30-da0b85b52de1 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:46:13.874444 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-3c8d3943-a0fd-4e33-8167-5c4285eb13f3 tempest-AttachVolumeNegativeTest-17004004 None] Created reservations ['0e3a397f-8e63-4f21-bb02-07858ad4319f', 'c9afab49-0357-4fc8-a8d8-b10027d43b6d', '1770365c-4f61-423a-b91d-838a4e5fe6ff', '4f8613b5-f016-4693-8f5a-900db6046072'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:46:14.034908 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3c8d3943-a0fd-4e33-8167-5c4285eb13f3 tempest-AttachVolumeNegativeTest-17004004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:46:14.060542 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3c8d3943-a0fd-4e33-8167-5c4285eb13f3 tempest-AttachVolumeNegativeTest-17004004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:46:14.085291 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-3c8d3943-a0fd-4e33-8167-5c4285eb13f3 tempest-AttachVolumeNegativeTest-17004004 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:46:14.089171 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-3c8d3943-a0fd-4e33-8167-5c4285eb13f3 tempest-AttachVolumeNegativeTest-17004004 None] Deleted volume successfully.
Jul 16 21:46:14.194977 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3c8d3943-a0fd-4e33-8167-5c4285eb13f3 tempest-AttachVolumeNegativeTest-17004004 None] Lock "cinder-0e8d79ef-dae3-4fef-bd30-da0b85b52de1-delete_volume" released by "delete_volume" :: held 2.969s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:46:14.755103 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-2d02ecb2-0f16-4261-914f-ceb07799c8ef tempest-AttachVolumeNegativeTest-17004004 None] Acquiring lock "cinder-64cfebc6-4a34-42c3-8e38-188693d74ff7-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:46:14.768783 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-2d02ecb2-0f16-4261-914f-ceb07799c8ef tempest-AttachVolumeNegativeTest-17004004 None] Lock "cinder-64cfebc6-4a34-42c3-8e38-188693d74ff7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:46:14.888873 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2d02ecb2-0f16-4261-914f-ceb07799c8ef tempest-AttachVolumeNegativeTest-17004004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:46:15.064621 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2d02ecb2-0f16-4261-914f-ceb07799c8ef tempest-AttachVolumeNegativeTest-17004004 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:46:15.065253 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2d02ecb2-0f16-4261-914f-ceb07799c8ef tempest-AttachVolumeNegativeTest-17004004 None] Volume volume-64cfebc6-4a34-42c3-8e38-188693d74ff7 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:46:15.173750 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2d02ecb2-0f16-4261-914f-ceb07799c8ef tempest-AttachVolumeNegativeTest-17004004 None] deleting rbd volume volume-64cfebc6-4a34-42c3-8e38-188693d74ff7 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:46:17.770776 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=59,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:46:17.871809 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-2d02ecb2-0f16-4261-914f-ceb07799c8ef tempest-AttachVolumeNegativeTest-17004004 None] Created reservations ['b48352fa-29f4-4591-8aed-7b8e961ac425', 'db71aacd-af77-4371-a1dd-020ceaf0c96a', 'bcad3726-1abd-4755-8848-6afd2ffcf7cc', 'e3e10b6f-c836-4388-ae5a-31be58ed2e4c'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:46:18.138032 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2d02ecb2-0f16-4261-914f-ceb07799c8ef tempest-AttachVolumeNegativeTest-17004004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:46:18.174904 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2d02ecb2-0f16-4261-914f-ceb07799c8ef tempest-AttachVolumeNegativeTest-17004004 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:46:18.232615 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-2d02ecb2-0f16-4261-914f-ceb07799c8ef tempest-AttachVolumeNegativeTest-17004004 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:46:18.254394 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-2d02ecb2-0f16-4261-914f-ceb07799c8ef tempest-AttachVolumeNegativeTest-17004004 None] Deleted volume successfully.
Jul 16 21:46:18.328067 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-2d02ecb2-0f16-4261-914f-ceb07799c8ef tempest-AttachVolumeNegativeTest-17004004 None] Lock "cinder-64cfebc6-4a34-42c3-8e38-188693d74ff7-delete_volume" released by "delete_volume" :: held 3.563s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:46:24.597019 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=62,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:46:34.610491 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1,cinder:SELECT=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:46:38.421806 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:46:38.422567 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:46:38.448859 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:46:38.473126 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:46:44.603817 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:47:14.597191 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:47:24.602042 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:47:38.418024 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:47:38.418744 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:47:38.444234 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:47:38.482877 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:47:44.602359 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:47:54.599649 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:48:24.598709 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:48:34.594388 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:48:38.420133 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:48:38.420859 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:48:38.457070 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:48:38.604855 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:48:54.592752 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:49:04.601217 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:49:24.597403 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:49:34.606155 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:49:38.420168 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:49:38.420917 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:49:38.446408 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:49:38.477798 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:49:54.609833 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:50:14.615319 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:50:24.617778 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:50:34.606853 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:50:38.425126 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:50:38.426970 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:50:38.489435 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:50:38.555427 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:50:54.609660 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:50:58.253022 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-1d14b56d-79f5-4695-be5e-c3fedb836303 req-4820323e-49f4-4b3d-95dd-6221a4646396 tempest-TestVolumeBackupRestore-577066854 None] Terminate volume connection completed successfully.
Jul 16 21:50:58.253607 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-1d14b56d-79f5-4695-be5e-c3fedb836303 req-4820323e-49f4-4b3d-95dd-6221a4646396 tempest-TestVolumeBackupRestore-577066854 None] Deleting attachment 94ddb0bb-4ce9-4972-a08c-ca3c9a1d3244. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 21:51:01.064902 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f9d6d4ce-c1f7-4544-9bc7-ba78fc60a720 tempest-TestVolumeBackupRestore-577066854 None] Acquiring lock "cinder-34b057b6-39af-4a53-9a45-d9404aea035f-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:51:01.076424 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f9d6d4ce-c1f7-4544-9bc7-ba78fc60a720 tempest-TestVolumeBackupRestore-577066854 None] Lock "cinder-34b057b6-39af-4a53-9a45-d9404aea035f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:51:01.190320 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f9d6d4ce-c1f7-4544-9bc7-ba78fc60a720 tempest-TestVolumeBackupRestore-577066854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:02.923336 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f9d6d4ce-c1f7-4544-9bc7-ba78fc60a720 tempest-TestVolumeBackupRestore-577066854 None] Volume volume-34b057b6-39af-4a53-9a45-d9404aea035f is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:51:03.390070 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f9d6d4ce-c1f7-4544-9bc7-ba78fc60a720 tempest-TestVolumeBackupRestore-577066854 None] deleting rbd volume volume-34b057b6-39af-4a53-9a45-d9404aea035f {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:51:03.394915 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5680d8ba-aca8-477c-a48c-4746ba7a7fd2 tempest-TestVolumeBackupRestore-577066854 None] Acquiring lock "cinder-60fe0e37-1c20-4c04-a124-84e193cfdd27-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:51:03.405368 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5680d8ba-aca8-477c-a48c-4746ba7a7fd2 tempest-TestVolumeBackupRestore-577066854 None] Lock "cinder-60fe0e37-1c20-4c04-a124-84e193cfdd27-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:51:03.548042 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5680d8ba-aca8-477c-a48c-4746ba7a7fd2 tempest-TestVolumeBackupRestore-577066854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:05.922796 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5680d8ba-aca8-477c-a48c-4746ba7a7fd2 tempest-TestVolumeBackupRestore-577066854 None] deleting rbd volume volume-60fe0e37-1c20-4c04-a124-84e193cfdd27 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:51:05.930413 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:51:05.950205 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Flow 'volume_create_manager' (02c7d67b-387f-4bb5-8ab8-591c3c60415f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:51:05.956550 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea4a971-fdaf-4e1b-9bca-3ba1bcf64806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:05.963386 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=17,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:51:05.979208 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea4a971-fdaf-4e1b-9bca-3ba1bcf64806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2005063892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=875c104d-859b-4270-aaa8-6457669e816a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5796a2bbfe294f219152381b3d3e98f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:51:03Z,use_quota=True,user_id='11b7995709444537bc26f9feed8e1288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:05.984461 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773536dc-7a2e-4352-a7de-b1751362ccfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:05.988463 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773536dc-7a2e-4352-a7de-b1751362ccfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:05.993415 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87eb495d-ab54-4cd4-99e6-49bca76dbda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:05.997453 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87eb495d-ab54-4cd4-99e6-49bca76dbda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '875c104d-859b-4270-aaa8-6457669e816a', 'volume_name': 'volume-875c104d-859b-4270-aaa8-6457669e816a', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:06.002282 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (422efcf9-e674-4be2-b09a-cc77a8f04541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:06.006172 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (422efcf9-e674-4be2-b09a-cc77a8f04541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:06.010801 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (086bc937-d202-4d06-a905-7d08794916f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:06.012001 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Volume 875c104d-859b-4270-aaa8-6457669e816a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-875c104d-859b-4270-aaa8-6457669e816a', 'volume_size': 1}
Jul 16 21:51:06.012397 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] creating volume 'volume-875c104d-859b-4270-aaa8-6457669e816a' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:51:06.013161 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:06.936265 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:51:06.936938 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:51:06.940514 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (086bc937-d202-4d06-a905-7d08794916f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-875c104d-859b-4270-aaa8-6457669e816a', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:06.945978 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71016e5c-0a13-4751-bf25-8ce199648129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:07.041466 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Volume volume-875c104d-859b-4270-aaa8-6457669e816a (875c104d-859b-4270-aaa8-6457669e816a): created successfully
Jul 16 21:51:07.045215 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71016e5c-0a13-4751-bf25-8ce199648129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:07.050821 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Flow 'volume_create_manager' (02c7d67b-387f-4bb5-8ab8-591c3c60415f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:51:07.136486 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-a9ea97d1-b958-4802-85ec-2b6fb2204bd9 tempest-VolumesListAdminTestJSON-489731138 None] Created volume successfully.
Jul 16 21:51:08.288553 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:51:08.308031 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Flow 'volume_create_manager' (36162027-2d1e-442f-9dfe-9519bd3b7cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:51:08.316943 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae577287-ca43-4403-a26d-e284a1434d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:08.336760 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae577287-ca43-4403-a26d-e284a1434d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-68399061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c93432c2-9e31-4616-a089-564da4d614dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5796a2bbfe294f219152381b3d3e98f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:51:08Z,use_quota=True,user_id='11b7995709444537bc26f9feed8e1288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:08.342024 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00637718-0eb9-4bde-981d-e17569bdd333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:08.346100 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00637718-0eb9-4bde-981d-e17569bdd333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:08.352045 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0583e4f-902a-4eb4-9a27-37ed97c4d989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:08.356187 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0583e4f-902a-4eb4-9a27-37ed97c4d989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c93432c2-9e31-4616-a089-564da4d614dc', 'volume_name': 'volume-c93432c2-9e31-4616-a089-564da4d614dc', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:08.361120 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a254dd44-eb03-46b9-8d00-1dc7b2ecb2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:08.365200 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a254dd44-eb03-46b9-8d00-1dc7b2ecb2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:08.369827 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f066a14c-66cb-4688-aff9-23928fc7e96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:08.370925 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Volume c93432c2-9e31-4616-a089-564da4d614dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c93432c2-9e31-4616-a089-564da4d614dc', 'volume_size': 1}
Jul 16 21:51:08.371340 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] creating volume 'volume-c93432c2-9e31-4616-a089-564da4d614dc' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:51:08.371984 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:09.441947 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:51:09.442611 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:51:09.446991 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f066a14c-66cb-4688-aff9-23928fc7e96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c93432c2-9e31-4616-a089-564da4d614dc', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:09.451473 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46a08eb-92be-465d-8b37-21492c91f185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:09.549181 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Volume volume-c93432c2-9e31-4616-a089-564da4d614dc (c93432c2-9e31-4616-a089-564da4d614dc): created successfully
Jul 16 21:51:09.553181 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46a08eb-92be-465d-8b37-21492c91f185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:09.558668 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Flow 'volume_create_manager' (36162027-2d1e-442f-9dfe-9519bd3b7cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:51:09.657821 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-1cab067d-9e66-403f-a3c6-1647f4330026 tempest-VolumesListAdminTestJSON-489731138 None] Created volume successfully.
Jul 16 21:51:11.026767 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:51:11.047828 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Flow 'volume_create_manager' (8332c316-1616-4881-b423-e823a019f7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:51:11.055480 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5051efb-ba58-43fc-945c-dce68de9fa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:11.072407 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5051efb-ba58-43fc-945c-dce68de9fa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-159285324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=14775b71-c022-4905-ad34-f648ddd8240f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5796a2bbfe294f219152381b3d3e98f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:51:11Z,use_quota=True,user_id='11b7995709444537bc26f9feed8e1288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:11.077541 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9956bd-7789-4c11-8db3-ed4eebeb8cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:11.082951 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9956bd-7789-4c11-8db3-ed4eebeb8cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:11.089299 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caee151-00be-4229-acdf-05d29343e3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:11.093271 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caee151-00be-4229-acdf-05d29343e3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14775b71-c022-4905-ad34-f648ddd8240f', 'volume_name': 'volume-14775b71-c022-4905-ad34-f648ddd8240f', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:11.098668 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764a86a4-deee-411b-ba20-f71f4f216efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:11.104279 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764a86a4-deee-411b-ba20-f71f4f216efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:11.108925 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a55c78c-0af9-4c8e-bc69-131c9c1ba3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:11.109976 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Volume 14775b71-c022-4905-ad34-f648ddd8240f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14775b71-c022-4905-ad34-f648ddd8240f', 'volume_size': 1}
Jul 16 21:51:11.110367 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] creating volume 'volume-14775b71-c022-4905-ad34-f648ddd8240f' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:51:11.111031 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:11.981735 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:51:11.982117 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:51:11.985729 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a55c78c-0af9-4c8e-bc69-131c9c1ba3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14775b71-c022-4905-ad34-f648ddd8240f', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:11.990341 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82649814-92f3-4c50-9f8a-0fa7637f8f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:12.086456 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Volume volume-14775b71-c022-4905-ad34-f648ddd8240f (14775b71-c022-4905-ad34-f648ddd8240f): created successfully
Jul 16 21:51:12.090028 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82649814-92f3-4c50-9f8a-0fa7637f8f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:12.095446 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Flow 'volume_create_manager' (8332c316-1616-4881-b423-e823a019f7fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:51:12.159141 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-6366ee7d-e011-4001-8c81-304ad79ae865 tempest-VolumesListAdminTestJSON-489731138 None] Created volume successfully.
Jul 16 21:51:12.425014 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5680d8ba-aca8-477c-a48c-4746ba7a7fd2 tempest-TestVolumeBackupRestore-577066854 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:51:12.579207 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5680d8ba-aca8-477c-a48c-4746ba7a7fd2 tempest-TestVolumeBackupRestore-577066854 None] deleting parent snapshot volume-60fe0e37-1c20-4c04-a124-84e193cfdd27.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:51:14.231584 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:51:14.251431 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Flow 'volume_create_manager' (bb86715e-72c7-4e76-b7c9-b4942bd1f31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:51:14.258650 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13dbeae-55f7-4db3-87cc-048a3a82be13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:14.271062 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-5680d8ba-aca8-477c-a48c-4746ba7a7fd2 tempest-TestVolumeBackupRestore-577066854 None] Created reservations ['52edeae0-bb6a-4c32-b17c-e94392a204db', 'd67c3174-f105-4813-ac83-31f304ce4923', '26fef919-1fc9-447b-b318-fb1815bad869', 'ac0970bf-4344-42d1-a2f6-a7365cf497fb'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:51:14.283530 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13dbeae-55f7-4db3-87cc-048a3a82be13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=cc14948a-f0e6-49e7-8d6c-09e68d9f06ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3634ca9f05f49a7ab05286b923c4a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:51:14Z,use_quota=True,user_id='73651d06f7a84fb1af56b0da49992932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:14.289096 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b027fd8-c67d-425b-8b29-26b476aa65c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:14.293200 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b027fd8-c67d-425b-8b29-26b476aa65c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:14.298230 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da5d209-9969-4753-9af1-122346e75c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:14.302363 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da5d209-9969-4753-9af1-122346e75c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc14948a-f0e6-49e7-8d6c-09e68d9f06ff', 'volume_name': 'volume-cc14948a-f0e6-49e7-8d6c-09e68d9f06ff', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:14.307872 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e9054e-5ab6-4a7a-8b6f-1ffcf2e5344e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:14.311897 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e9054e-5ab6-4a7a-8b6f-1ffcf2e5344e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:14.316487 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd96a693-7804-4a29-b2dd-dfb2ae4ac34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:14.317573 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Volume cc14948a-f0e6-49e7-8d6c-09e68d9f06ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc14948a-f0e6-49e7-8d6c-09e68d9f06ff', 'volume_size': 1}
Jul 16 21:51:14.317967 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] creating volume 'volume-cc14948a-f0e6-49e7-8d6c-09e68d9f06ff' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:51:14.319592 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:14.467642 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-f9d6d4ce-c1f7-4544-9bc7-ba78fc60a720 tempest-TestVolumeBackupRestore-577066854 None] Created reservations ['b7fe8e59-34b8-4143-a637-875f1d746e2f', '0dbc4142-1a28-4766-a14b-7dc0ea2e13c2', '58796929-2f8e-421a-b37a-fbee4053fd78', '8b5c85e5-781e-469c-8759-d4a6e7db7427'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:51:14.677910 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5680d8ba-aca8-477c-a48c-4746ba7a7fd2 tempest-TestVolumeBackupRestore-577066854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:14.790606 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5680d8ba-aca8-477c-a48c-4746ba7a7fd2 tempest-TestVolumeBackupRestore-577066854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:14.870120 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-5680d8ba-aca8-477c-a48c-4746ba7a7fd2 tempest-TestVolumeBackupRestore-577066854 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:51:14.880715 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:51:14.881227 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:51:14.885631 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd96a693-7804-4a29-b2dd-dfb2ae4ac34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc14948a-f0e6-49e7-8d6c-09e68d9f06ff', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:14.890389 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0efc69-4ff3-4222-a48a-a994b3a6b614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:14.906803 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-5680d8ba-aca8-477c-a48c-4746ba7a7fd2 tempest-TestVolumeBackupRestore-577066854 None] Deleted volume successfully.
Jul 16 21:51:14.966262 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Volume volume-cc14948a-f0e6-49e7-8d6c-09e68d9f06ff (cc14948a-f0e6-49e7-8d6c-09e68d9f06ff): created successfully
Jul 16 21:51:14.970045 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0efc69-4ff3-4222-a48a-a994b3a6b614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:14.975927 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Flow 'volume_create_manager' (bb86715e-72c7-4e76-b7c9-b4942bd1f31c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:51:15.025604 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f9d6d4ce-c1f7-4544-9bc7-ba78fc60a720 tempest-TestVolumeBackupRestore-577066854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:15.053455 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f9d6d4ce-c1f7-4544-9bc7-ba78fc60a720 tempest-TestVolumeBackupRestore-577066854 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:15.080764 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-f9d6d4ce-c1f7-4544-9bc7-ba78fc60a720 tempest-TestVolumeBackupRestore-577066854 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:51:15.085041 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f9d6d4ce-c1f7-4544-9bc7-ba78fc60a720 tempest-TestVolumeBackupRestore-577066854 None] Deleted volume successfully.
Jul 16 21:51:15.090121 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f4a21ee3-0723-4d08-b62b-9e982e1533e3 tempest-VolumesListAdminTestJSON-908101501 None] Created volume successfully.
Jul 16 21:51:15.093188 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5680d8ba-aca8-477c-a48c-4746ba7a7fd2 tempest-TestVolumeBackupRestore-577066854 None] Lock "cinder-60fe0e37-1c20-4c04-a124-84e193cfdd27-delete_volume" released by "delete_volume" :: held 11.688s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:51:15.180806 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-f9d6d4ce-c1f7-4544-9bc7-ba78fc60a720 tempest-TestVolumeBackupRestore-577066854 None] Lock "cinder-34b057b6-39af-4a53-9a45-d9404aea035f-delete_volume" released by "delete_volume" :: held 14.104s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:51:16.203768 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-bd82e15c-33c6-4610-88c0-bb9a77981b6d tempest-VolumesListAdminTestJSON-908101501 None] Acquiring lock "cinder-cc14948a-f0e6-49e7-8d6c-09e68d9f06ff-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:51:16.217062 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-bd82e15c-33c6-4610-88c0-bb9a77981b6d tempest-VolumesListAdminTestJSON-908101501 None] Lock "cinder-cc14948a-f0e6-49e7-8d6c-09e68d9f06ff-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:51:16.327103 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bd82e15c-33c6-4610-88c0-bb9a77981b6d tempest-VolumesListAdminTestJSON-908101501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:16.429249 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bd82e15c-33c6-4610-88c0-bb9a77981b6d tempest-VolumesListAdminTestJSON-908101501 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:51:16.429701 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bd82e15c-33c6-4610-88c0-bb9a77981b6d tempest-VolumesListAdminTestJSON-908101501 None] Volume volume-cc14948a-f0e6-49e7-8d6c-09e68d9f06ff is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:51:16.510192 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bd82e15c-33c6-4610-88c0-bb9a77981b6d tempest-VolumesListAdminTestJSON-908101501 None] deleting rbd volume volume-cc14948a-f0e6-49e7-8d6c-09e68d9f06ff {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:51:16.515074 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-cc2947d6-33a2-42ad-b4fc-e2a64e18b503 tempest-VolumesListAdminTestJSON-489731138 None] Acquiring lock "cinder-14775b71-c022-4905-ad34-f648ddd8240f-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:51:16.529165 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-cc2947d6-33a2-42ad-b4fc-e2a64e18b503 tempest-VolumesListAdminTestJSON-489731138 None] Lock "cinder-14775b71-c022-4905-ad34-f648ddd8240f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:51:16.614249 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cc2947d6-33a2-42ad-b4fc-e2a64e18b503 tempest-VolumesListAdminTestJSON-489731138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:16.709231 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cc2947d6-33a2-42ad-b4fc-e2a64e18b503 tempest-VolumesListAdminTestJSON-489731138 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:51:16.709660 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cc2947d6-33a2-42ad-b4fc-e2a64e18b503 tempest-VolumesListAdminTestJSON-489731138 None] Volume volume-14775b71-c022-4905-ad34-f648ddd8240f is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:51:16.839338 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cc2947d6-33a2-42ad-b4fc-e2a64e18b503 tempest-VolumesListAdminTestJSON-489731138 None] deleting rbd volume volume-14775b71-c022-4905-ad34-f648ddd8240f {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:51:21.806548 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-bd82e15c-33c6-4610-88c0-bb9a77981b6d tempest-VolumesListAdminTestJSON-908101501 None] Created reservations ['eb35d0d4-7f2d-45fb-b0e6-035f20facd05', '17ed0305-5068-4609-bfbf-3cf53cdc2426', 'e7a47dcb-da8a-43a6-8d14-78bb70cf3137', '04f6a3a4-6a62-44f6-b739-8c3f87180cba'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:51:21.825409 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=67,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:51:21.828996 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-cc2947d6-33a2-42ad-b4fc-e2a64e18b503 tempest-VolumesListAdminTestJSON-489731138 None] Created reservations ['dfb8916e-9991-4747-89e2-7b948f7b66a2', 'd8646dcc-e8cc-4a18-8390-6c953e2ff278', '3385019f-e20d-4b2d-8097-20b7c9e62227', 'da75aca7-536b-40f8-9907-bbc5e1d4fab8'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:51:21.939323 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=35,cinder:SELECT=50,cinder:DELETE=4,cinder:INSERT=11 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:51:22.031392 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cc2947d6-33a2-42ad-b4fc-e2a64e18b503 tempest-VolumesListAdminTestJSON-489731138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:22.063515 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-cc2947d6-33a2-42ad-b4fc-e2a64e18b503 tempest-VolumesListAdminTestJSON-489731138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:22.183417 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-cc2947d6-33a2-42ad-b4fc-e2a64e18b503 tempest-VolumesListAdminTestJSON-489731138 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:51:22.200259 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-cc2947d6-33a2-42ad-b4fc-e2a64e18b503 tempest-VolumesListAdminTestJSON-489731138 None] Deleted volume successfully.
Jul 16 21:51:22.352381 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bd82e15c-33c6-4610-88c0-bb9a77981b6d tempest-VolumesListAdminTestJSON-908101501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:22.417263 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bd82e15c-33c6-4610-88c0-bb9a77981b6d tempest-VolumesListAdminTestJSON-908101501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:22.463963 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-bd82e15c-33c6-4610-88c0-bb9a77981b6d tempest-VolumesListAdminTestJSON-908101501 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:51:22.468670 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-bd82e15c-33c6-4610-88c0-bb9a77981b6d tempest-VolumesListAdminTestJSON-908101501 None] Deleted volume successfully.
Jul 16 21:51:22.476395 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-cc2947d6-33a2-42ad-b4fc-e2a64e18b503 tempest-VolumesListAdminTestJSON-489731138 None] Lock "cinder-14775b71-c022-4905-ad34-f648ddd8240f-delete_volume" released by "delete_volume" :: held 5.947s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:51:22.549962 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-bd82e15c-33c6-4610-88c0-bb9a77981b6d tempest-VolumesListAdminTestJSON-908101501 None] Lock "cinder-cc14948a-f0e6-49e7-8d6c-09e68d9f06ff-delete_volume" released by "delete_volume" :: held 6.333s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:51:23.023352 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9a00764c-5934-4c2f-9590-00143acf7236 tempest-VolumesListAdminTestJSON-489731138 None] Acquiring lock "cinder-c93432c2-9e31-4616-a089-564da4d614dc-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:51:23.036126 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9a00764c-5934-4c2f-9590-00143acf7236 tempest-VolumesListAdminTestJSON-489731138 None] Lock "cinder-c93432c2-9e31-4616-a089-564da4d614dc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:51:23.132611 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9a00764c-5934-4c2f-9590-00143acf7236 tempest-VolumesListAdminTestJSON-489731138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:23.284460 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9a00764c-5934-4c2f-9590-00143acf7236 tempest-VolumesListAdminTestJSON-489731138 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:51:23.284901 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9a00764c-5934-4c2f-9590-00143acf7236 tempest-VolumesListAdminTestJSON-489731138 None] Volume volume-c93432c2-9e31-4616-a089-564da4d614dc is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:51:23.387563 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9a00764c-5934-4c2f-9590-00143acf7236 tempest-VolumesListAdminTestJSON-489731138 None] deleting rbd volume volume-c93432c2-9e31-4616-a089-564da4d614dc {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:51:26.475881 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-9a00764c-5934-4c2f-9590-00143acf7236 tempest-VolumesListAdminTestJSON-489731138 None] Created reservations ['b9d21fde-5303-451f-af2b-3575c900d257', '6ea275d5-6a39-481c-9e30-4125055185e9', '3e744d2a-7dcb-46b3-9fe6-47508db54bb2', '5e10bd32-a11d-40a1-9d53-5c2ba5e46803'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:51:26.698526 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9a00764c-5934-4c2f-9590-00143acf7236 tempest-VolumesListAdminTestJSON-489731138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:26.723441 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-9a00764c-5934-4c2f-9590-00143acf7236 tempest-VolumesListAdminTestJSON-489731138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:26.753448 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-9a00764c-5934-4c2f-9590-00143acf7236 tempest-VolumesListAdminTestJSON-489731138 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:51:26.758071 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-9a00764c-5934-4c2f-9590-00143acf7236 tempest-VolumesListAdminTestJSON-489731138 None] Deleted volume successfully.
Jul 16 21:51:26.822287 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-9a00764c-5934-4c2f-9590-00143acf7236 tempest-VolumesListAdminTestJSON-489731138 None] Lock "cinder-c93432c2-9e31-4616-a089-564da4d614dc-delete_volume" released by "delete_volume" :: held 3.787s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:51:27.498679 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3e87e417-6d85-43e9-9e7b-5d5b25529a8d tempest-VolumesListAdminTestJSON-489731138 None] Acquiring lock "cinder-875c104d-859b-4270-aaa8-6457669e816a-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:51:27.511001 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3e87e417-6d85-43e9-9e7b-5d5b25529a8d tempest-VolumesListAdminTestJSON-489731138 None] Lock "cinder-875c104d-859b-4270-aaa8-6457669e816a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:51:27.595833 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3e87e417-6d85-43e9-9e7b-5d5b25529a8d tempest-VolumesListAdminTestJSON-489731138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:27.714211 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3e87e417-6d85-43e9-9e7b-5d5b25529a8d tempest-VolumesListAdminTestJSON-489731138 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:51:27.714643 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3e87e417-6d85-43e9-9e7b-5d5b25529a8d tempest-VolumesListAdminTestJSON-489731138 None] Volume volume-875c104d-859b-4270-aaa8-6457669e816a is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:51:27.758864 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3e87e417-6d85-43e9-9e7b-5d5b25529a8d tempest-VolumesListAdminTestJSON-489731138 None] deleting rbd volume volume-875c104d-859b-4270-aaa8-6457669e816a {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:51:30.206646 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-3e87e417-6d85-43e9-9e7b-5d5b25529a8d tempest-VolumesListAdminTestJSON-489731138 None] Created reservations ['91c6269d-fada-4e9a-bef8-69b6f379f0da', 'abf8ec43-a7ff-4e37-8cb2-08a9ae0a4fe5', 'ab685b51-2d30-46da-8f75-78e564271ff5', 'ce4afe0c-357c-4754-bc35-84eeb4614e5d'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:51:30.400665 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3e87e417-6d85-43e9-9e7b-5d5b25529a8d tempest-VolumesListAdminTestJSON-489731138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:30.426685 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3e87e417-6d85-43e9-9e7b-5d5b25529a8d tempest-VolumesListAdminTestJSON-489731138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:30.453914 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-3e87e417-6d85-43e9-9e7b-5d5b25529a8d tempest-VolumesListAdminTestJSON-489731138 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:51:30.458286 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-3e87e417-6d85-43e9-9e7b-5d5b25529a8d tempest-VolumesListAdminTestJSON-489731138 None] Deleted volume successfully.
Jul 16 21:51:30.546945 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3e87e417-6d85-43e9-9e7b-5d5b25529a8d tempest-VolumesListAdminTestJSON-489731138 None] Lock "cinder-875c104d-859b-4270-aaa8-6457669e816a-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:51:35.182798 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:51:35.203346 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Flow 'volume_create_manager' (fc3e848f-9462-4d7b-a6bf-b1f19ce80044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:51:35.210088 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a053845-41f7-4cec-bec4-65b0dc929157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:35.226757 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a053845-41f7-4cec-bec4-65b0dc929157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-19694121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=50c9b644-1bf1-413a-8430-1b4866457223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3a23b299de4c0184811e7e28976390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:51:35Z,use_quota=True,user_id='48cd7a9abfbc4849ba4ac5fe581b5ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:35.232515 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de92df0d-2d2f-476b-b459-6d276c0260cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:35.236557 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de92df0d-2d2f-476b-b459-6d276c0260cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:35.242499 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36e63a3-fedc-4987-a34f-d8fb9919cbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:35.246570 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36e63a3-fedc-4987-a34f-d8fb9919cbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50c9b644-1bf1-413a-8430-1b4866457223', 'volume_name': 'volume-50c9b644-1bf1-413a-8430-1b4866457223', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:35.251434 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db32e2cf-a5be-4b86-a698-ce2acb4772c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:35.255295 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db32e2cf-a5be-4b86-a698-ce2acb4772c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:35.260564 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47744ef4-3d33-404c-8044-fe877555bb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:35.261613 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Volume 50c9b644-1bf1-413a-8430-1b4866457223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50c9b644-1bf1-413a-8430-1b4866457223', 'volume_size': 1}
Jul 16 21:51:35.262008 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] creating volume 'volume-50c9b644-1bf1-413a-8430-1b4866457223' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:51:35.262766 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:35.902374 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:51:35.902893 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:51:35.908534 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47744ef4-3d33-404c-8044-fe877555bb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50c9b644-1bf1-413a-8430-1b4866457223', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:35.914733 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5077b526-6e02-491a-b5b9-002a3b8a10a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:36.023517 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Volume volume-50c9b644-1bf1-413a-8430-1b4866457223 (50c9b644-1bf1-413a-8430-1b4866457223): created successfully
Jul 16 21:51:36.027103 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5077b526-6e02-491a-b5b9-002a3b8a10a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:36.032463 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Flow 'volume_create_manager' (fc3e848f-9462-4d7b-a6bf-b1f19ce80044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:51:36.115259 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-13e8f7e4-6313-4c25-8e1a-10aa37eb22ba tempest-VolumesBackupsV39Test-324268337 None] Created volume successfully.
Jul 16 21:51:37.944830 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-4bdc3b35-f2af-4fab-b962-dfb7ee298e34 tempest-VolumesBackupsV39Test-324268337 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-07-16T21:51:37Z,data_timestamp=2022-07-16T21:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-928091723',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=6924fea8-5460-459b-8d48-81a870090473,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='aa3a23b299de4c0184811e7e28976390',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='48cd7a9abfbc4849ba4ac5fe581b5ec5',volume_id=50c9b644-1bf1-413a-8430-1b4866457223)
Jul 16 21:51:37.945577 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.backup.rpcapi [None req-4bdc3b35-f2af-4fab-b962-dfb7ee298e34 tempest-VolumesBackupsV39Test-324268337 None] continue_backup in rpcapi backup_id 6924fea8-5460-459b-8d48-81a870090473 {{(pid=131857) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Jul 16 21:51:38.052408 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-4bdc3b35-f2af-4fab-b962-dfb7ee298e34 tempest-VolumesBackupsV39Test-324268337 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 21:51:38.421574 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:51:38.423198 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:38.477332 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:38.534817 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:51:39.063969 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [None req-4bdc3b35-f2af-4fab-b962-dfb7ee298e34 tempest-VolumesBackupsV39Test-324268337 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.011s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 21:51:39.299786 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-4bdc3b35-f2af-4fab-b962-dfb7ee298e34 tempest-VolumesBackupsV39Test-324268337 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-50c9b644-1bf1-413a-8430-1b4866457223', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '50c9b644-1bf1-413a-8430-1b4866457223', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 21:51:39.299786 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-4bdc3b35-f2af-4fab-b962-dfb7ee298e34 tempest-VolumesBackupsV39Test-324268337 None] Initialize volume connection completed successfully.
Jul 16 21:51:42.723745 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-4bdc3b35-f2af-4fab-b962-dfb7ee298e34 tempest-VolumesBackupsV39Test-324268337 None] Terminate volume connection completed successfully.
Jul 16 21:51:42.754756 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-4bdc3b35-f2af-4fab-b962-dfb7ee298e34 tempest-VolumesBackupsV39Test-324268337 None] Remove volume export completed successfully.
Jul 16 21:51:49.591236 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-071017a5-dd20-4c3c-9a17-6d4e93d58e93 tempest-VolumesBackupsV39Test-324268337 None] Acquiring lock "cinder-50c9b644-1bf1-413a-8430-1b4866457223-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:51:49.613444 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-071017a5-dd20-4c3c-9a17-6d4e93d58e93 tempest-VolumesBackupsV39Test-324268337 None] Lock "cinder-50c9b644-1bf1-413a-8430-1b4866457223-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:51:49.767475 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-071017a5-dd20-4c3c-9a17-6d4e93d58e93 tempest-VolumesBackupsV39Test-324268337 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:51.888750 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-071017a5-dd20-4c3c-9a17-6d4e93d58e93 tempest-VolumesBackupsV39Test-324268337 None] Volume volume-50c9b644-1bf1-413a-8430-1b4866457223 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:51:52.097823 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-071017a5-dd20-4c3c-9a17-6d4e93d58e93 tempest-VolumesBackupsV39Test-324268337 None] deleting rbd volume volume-50c9b644-1bf1-413a-8430-1b4866457223 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:51:54.328195 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=47,cinder:UPDATE=39,cinder:DELETE=5,cinder:INSERT=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:51:54.328897 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=44,cinder:UPDATE=16,cinder:INSERT=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:51:54.411407 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-071017a5-dd20-4c3c-9a17-6d4e93d58e93 tempest-VolumesBackupsV39Test-324268337 None] Created reservations ['8881ee86-0ccc-4cf0-b75c-989cca0a819a', '16b1b600-9ad4-41db-91dd-d4dedb4c0ae1', 'f101c6c1-2e47-4aad-abe8-5a7c7b0a6da2', '4590b2fd-159d-42df-9ef8-d4862e308e6c'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:51:54.560461 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-071017a5-dd20-4c3c-9a17-6d4e93d58e93 tempest-VolumesBackupsV39Test-324268337 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:54.602002 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-071017a5-dd20-4c3c-9a17-6d4e93d58e93 tempest-VolumesBackupsV39Test-324268337 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:54.656451 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-071017a5-dd20-4c3c-9a17-6d4e93d58e93 tempest-VolumesBackupsV39Test-324268337 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:51:54.666363 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-071017a5-dd20-4c3c-9a17-6d4e93d58e93 tempest-VolumesBackupsV39Test-324268337 None] Deleted volume successfully.
Jul 16 21:51:54.730581 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-071017a5-dd20-4c3c-9a17-6d4e93d58e93 tempest-VolumesBackupsV39Test-324268337 None] Lock "cinder-50c9b644-1bf1-413a-8430-1b4866457223-delete_volume" released by "delete_volume" :: held 5.117s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:51:58.051047 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:51:58.071722 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Flow 'volume_create_manager' (df278e53-ca0a-4e55-80da-4aaf2799b673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:51:58.078428 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e546919-12f0-42dd-bd1e-f09c225e43bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:58.097618 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e546919-12f0-42dd-bd1e-f09c225e43bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-428881506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7382cf42-685f-40b0-a5d7-40618858c4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfcc318e041846c88bc6a62219974f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:51:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:51:58Z,use_quota=True,user_id='b600e015a56e4daca812af298a194616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:58.102909 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93cddf8-12bd-4323-871c-b99cb7249f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:58.107654 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93cddf8-12bd-4323-871c-b99cb7249f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:58.112617 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d3af49-0a35-48c0-b1b6-83700f8d4cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:58.116624 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d3af49-0a35-48c0-b1b6-83700f8d4cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7382cf42-685f-40b0-a5d7-40618858c4fa', 'volume_name': 'volume-7382cf42-685f-40b0-a5d7-40618858c4fa', 'volume_size': 2}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:58.122258 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f1482b-d55d-46f4-b74b-b0ed35e01daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:58.126065 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f1482b-d55d-46f4-b74b-b0ed35e01daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:58.130701 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58472782-cfcf-40a7-8478-7df50af2ec6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:58.131775 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Volume 7382cf42-685f-40b0-a5d7-40618858c4fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7382cf42-685f-40b0-a5d7-40618858c4fa', 'volume_size': 2}
Jul 16 21:51:58.132167 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] creating volume 'volume-7382cf42-685f-40b0-a5d7-40618858c4fa' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:51:58.132928 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:58.471428 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:51:58.471817 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:51:58.475838 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58472782-cfcf-40a7-8478-7df50af2ec6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7382cf42-685f-40b0-a5d7-40618858c4fa', 'volume_size': 2}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:58.480682 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9b7615-209b-44a9-8246-d9ad5a092064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:51:58.577104 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Volume volume-7382cf42-685f-40b0-a5d7-40618858c4fa (7382cf42-685f-40b0-a5d7-40618858c4fa): created successfully
Jul 16 21:51:58.581098 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9b7615-209b-44a9-8246-d9ad5a092064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:51:58.589798 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Flow 'volume_create_manager' (df278e53-ca0a-4e55-80da-4aaf2799b673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:51:58.685433 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-8f9ba693-9969-449f-840b-6c029b77dfe6 tempest-VolumesCloneNegativeTest-442233978 None] Created volume successfully.
Jul 16 21:51:59.112358 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-155b66d9-b8b1-4313-8958-442f13a8145b tempest-VolumesCloneNegativeTest-442233978 None] Acquiring lock "cinder-7382cf42-685f-40b0-a5d7-40618858c4fa-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:51:59.123499 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-155b66d9-b8b1-4313-8958-442f13a8145b tempest-VolumesCloneNegativeTest-442233978 None] Lock "cinder-7382cf42-685f-40b0-a5d7-40618858c4fa-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:51:59.223088 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-155b66d9-b8b1-4313-8958-442f13a8145b tempest-VolumesCloneNegativeTest-442233978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:51:59.319048 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-155b66d9-b8b1-4313-8958-442f13a8145b tempest-VolumesCloneNegativeTest-442233978 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:51:59.319474 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-155b66d9-b8b1-4313-8958-442f13a8145b tempest-VolumesCloneNegativeTest-442233978 None] Volume volume-7382cf42-685f-40b0-a5d7-40618858c4fa is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:51:59.417555 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-155b66d9-b8b1-4313-8958-442f13a8145b tempest-VolumesCloneNegativeTest-442233978 None] deleting rbd volume volume-7382cf42-685f-40b0-a5d7-40618858c4fa {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:52:01.862714 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-155b66d9-b8b1-4313-8958-442f13a8145b tempest-VolumesCloneNegativeTest-442233978 None] Created reservations ['28c229fa-7bfb-4105-a137-81fcaae73f7c', 'e4c4251c-782e-44b6-91eb-c5a9e19f9e25', '7913a72e-d178-4208-a073-d1b4070b5b97', '75b96342-d200-4447-9114-adffddf5d594'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:52:02.040201 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-155b66d9-b8b1-4313-8958-442f13a8145b tempest-VolumesCloneNegativeTest-442233978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:52:02.064907 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-155b66d9-b8b1-4313-8958-442f13a8145b tempest-VolumesCloneNegativeTest-442233978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:52:02.090018 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-155b66d9-b8b1-4313-8958-442f13a8145b tempest-VolumesCloneNegativeTest-442233978 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:52:02.094188 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-155b66d9-b8b1-4313-8958-442f13a8145b tempest-VolumesCloneNegativeTest-442233978 None] Deleted volume successfully.
Jul 16 21:52:02.157737 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-155b66d9-b8b1-4313-8958-442f13a8145b tempest-VolumesCloneNegativeTest-442233978 None] Lock "cinder-7382cf42-685f-40b0-a5d7-40618858c4fa-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:52:15.940135 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=19,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:52:25.938734 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=37,cinder:INSERT=6,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:52:38.421223 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:52:38.421854 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:52:38.449156 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:52:38.474953 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:52:45.945109 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:53:05.951200 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:53:25.955438 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:53:38.420205 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:53:38.420871 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:53:38.450339 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:53:38.478319 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:53:45.970816 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:53:55.975372 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:54:05.982259 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:54:35.977948 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:54:38.424206 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:54:38.424868 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:54:38.455905 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:54:38.485885 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:54:55.974175 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:55:05.981480 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:55:12.334271 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:55:12.354020 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Flow 'volume_create_manager' (0e40aaf1-a4c2-4991-a6b5-da58014d7a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:55:12.360259 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a80973b-dcfe-48ac-a40b-222efd0aca69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:12.375686 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a80973b-dcfe-48ac-a40b-222efd0aca69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-811886708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=74bf5e24-0308-44b5-9f1a-4fc30f3d8e0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b9c27e50cc847c19a66003bcc034d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:55:12Z,use_quota=True,user_id='047e1d0d57b84834a05b6e64330a52e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:12.381110 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bccb8c84-894a-44c8-ad6c-5681992a5fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:12.385090 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bccb8c84-894a-44c8-ad6c-5681992a5fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:12.390020 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9bdcd10-a0c5-4eec-9346-b6ef3e116c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:12.394037 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9bdcd10-a0c5-4eec-9346-b6ef3e116c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74bf5e24-0308-44b5-9f1a-4fc30f3d8e0c', 'volume_name': 'volume-74bf5e24-0308-44b5-9f1a-4fc30f3d8e0c', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:12.399326 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e302d3e0-9f3f-4a89-b9fa-a1d004a3dc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:12.403098 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e302d3e0-9f3f-4a89-b9fa-a1d004a3dc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:12.407611 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc40c85-70fb-40ae-b56a-d17f79aceb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:12.408638 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Volume 74bf5e24-0308-44b5-9f1a-4fc30f3d8e0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74bf5e24-0308-44b5-9f1a-4fc30f3d8e0c', 'volume_size': 1}
Jul 16 21:55:12.409025 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] creating volume 'volume-74bf5e24-0308-44b5-9f1a-4fc30f3d8e0c' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:55:12.409768 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:55:12.834074 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:55:12.834474 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:55:12.838109 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc40c85-70fb-40ae-b56a-d17f79aceb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74bf5e24-0308-44b5-9f1a-4fc30f3d8e0c', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:12.842501 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b01b441-3a2b-46d7-b19f-0539dcb639a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:12.898441 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Volume volume-74bf5e24-0308-44b5-9f1a-4fc30f3d8e0c (74bf5e24-0308-44b5-9f1a-4fc30f3d8e0c): created successfully
Jul 16 21:55:12.902039 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b01b441-3a2b-46d7-b19f-0539dcb639a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:12.907266 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Flow 'volume_create_manager' (0e40aaf1-a4c2-4991-a6b5-da58014d7a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:55:12.967215 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d3d68b65-ffd0-4691-ad47-473f1a3e7db2 tempest-VolumesServicesTestJSON-2143483429 None] Created volume successfully.
Jul 16 21:55:13.436146 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-730ad0d1-e31c-4de7-9add-a41e2f312974 tempest-VolumesServicesTestJSON-2143483429 None] Acquiring lock "cinder-74bf5e24-0308-44b5-9f1a-4fc30f3d8e0c-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:55:13.445482 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-730ad0d1-e31c-4de7-9add-a41e2f312974 tempest-VolumesServicesTestJSON-2143483429 None] Lock "cinder-74bf5e24-0308-44b5-9f1a-4fc30f3d8e0c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:55:13.527646 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-730ad0d1-e31c-4de7-9add-a41e2f312974 tempest-VolumesServicesTestJSON-2143483429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:55:13.612567 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-730ad0d1-e31c-4de7-9add-a41e2f312974 tempest-VolumesServicesTestJSON-2143483429 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:55:13.613026 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-730ad0d1-e31c-4de7-9add-a41e2f312974 tempest-VolumesServicesTestJSON-2143483429 None] Volume volume-74bf5e24-0308-44b5-9f1a-4fc30f3d8e0c is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:55:13.676239 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-730ad0d1-e31c-4de7-9add-a41e2f312974 tempest-VolumesServicesTestJSON-2143483429 None] deleting rbd volume volume-74bf5e24-0308-44b5-9f1a-4fc30f3d8e0c {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:55:15.521129 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-730ad0d1-e31c-4de7-9add-a41e2f312974 tempest-VolumesServicesTestJSON-2143483429 None] Created reservations ['59b62273-1d3e-4d3d-ba65-00c1072cdb41', '41ea5d09-d517-4e99-955a-6f41046396bf', 'fe1055a6-f559-46ab-b725-2327f14b99fe', '4a655a4a-36c8-4e92-b2d7-fedd7aa71812'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:55:15.687277 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-730ad0d1-e31c-4de7-9add-a41e2f312974 tempest-VolumesServicesTestJSON-2143483429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:55:15.711053 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-730ad0d1-e31c-4de7-9add-a41e2f312974 tempest-VolumesServicesTestJSON-2143483429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:55:15.736525 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-730ad0d1-e31c-4de7-9add-a41e2f312974 tempest-VolumesServicesTestJSON-2143483429 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:55:15.741586 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-730ad0d1-e31c-4de7-9add-a41e2f312974 tempest-VolumesServicesTestJSON-2143483429 None] Deleted volume successfully.
Jul 16 21:55:15.804717 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-730ad0d1-e31c-4de7-9add-a41e2f312974 tempest-VolumesServicesTestJSON-2143483429 None] Lock "cinder-74bf5e24-0308-44b5-9f1a-4fc30f3d8e0c-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:55:25.981222 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=21,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:55:38.421511 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:55:38.422242 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:55:38.448627 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:55:38.476333 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:55:44.237473 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=23,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:55:44.305065 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:55:44.324491 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Flow 'volume_create_manager' (8304c12c-1d16-4bbd-8ec4-075dc607055a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:55:44.331290 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6f2ddb-eeca-4077-b7e3-3d9d574dc5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:44.348391 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6f2ddb-eeca-4077-b7e3-3d9d574dc5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1088916078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ce121469a145a4b00edd3a082413a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:55:44Z,use_quota=True,user_id='2331af9efc5e4af7a901621b7590e80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:44.353602 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef32a3ce-82e5-4602-8d81-0c019b943c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:44.358680 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef32a3ce-82e5-4602-8d81-0c019b943c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:44.363974 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779ea851-13b5-42de-aaba-81c7234cab62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:44.367943 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779ea851-13b5-42de-aaba-81c7234cab62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a', 'volume_name': 'volume-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:44.373005 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d701a48-d07f-4db6-bd6d-dda06f5dd5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:44.377271 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d701a48-d07f-4db6-bd6d-dda06f5dd5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:44.381753 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b748eb3-6b38-4316-96bf-4ca3784bb67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:44.382775 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Volume 948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a', 'volume_size': 1}
Jul 16 21:55:44.383187 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] creating volume 'volume-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:55:44.383922 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:55:44.712029 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:55:44.712329 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:55:44.715936 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b748eb3-6b38-4316-96bf-4ca3784bb67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:44.720698 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f49d6ce-a0a5-42a0-9690-82b0c0a0f6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:44.794726 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Volume volume-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a (948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a): created successfully
Jul 16 21:55:44.798741 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f49d6ce-a0a5-42a0-9690-82b0c0a0f6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:44.804033 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Flow 'volume_create_manager' (8304c12c-1d16-4bbd-8ec4-075dc607055a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:55:44.869158 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-55634e3a-9d6a-4376-8563-5d974056ca2c tempest-VolumesActionsTest-763750246 None] Created volume successfully.
Jul 16 21:55:45.271314 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e946bed3-739e-46f7-91aa-2d54ff05ad3e tempest-VolumesActionsTest-763750246 None] Acquiring lock "cinder-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a" by "attach_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:55:45.280665 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e946bed3-739e-46f7-91aa-2d54ff05ad3e tempest-VolumesActionsTest-763750246 None] Lock "cinder-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a" acquired by "attach_volume" :: waited 0.009s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:55:45.400506 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e946bed3-739e-46f7-91aa-2d54ff05ad3e tempest-VolumesActionsTest-763750246 None] Attaching volume 948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a to instance 2ba83fff-f116-4f5e-8711-550d4a6e2989 at mountpoint /dev/sdb on host None.
Jul 16 21:55:45.470290 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e946bed3-739e-46f7-91aa-2d54ff05ad3e tempest-VolumesActionsTest-763750246 None] Attach volume completed successfully.
Jul 16 21:55:45.474711 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e946bed3-739e-46f7-91aa-2d54ff05ad3e tempest-VolumesActionsTest-763750246 None] Lock "cinder-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a" released by "attach_volume" :: held 0.194s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:55:46.042634 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-8969d9a5-832a-49ae-bab7-a03fa051b8b2 tempest-VolumesActionsTest-2140470252 None] Terminate volume connection completed successfully.
Jul 16 21:55:46.065013 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8969d9a5-832a-49ae-bab7-a03fa051b8b2 tempest-VolumesActionsTest-2140470252 None] Acquiring lock "cinder-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a-detach_volume" by "detach_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:55:46.074553 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8969d9a5-832a-49ae-bab7-a03fa051b8b2 tempest-VolumesActionsTest-2140470252 None] Lock "cinder-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:55:46.085907 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-8969d9a5-832a-49ae-bab7-a03fa051b8b2 tempest-VolumesActionsTest-2140470252 None] Detaching volume 948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a from instance 2ba83fff-f116-4f5e-8711-550d4a6e2989.
Jul 16 21:55:46.263187 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-8969d9a5-832a-49ae-bab7-a03fa051b8b2 tempest-VolumesActionsTest-2140470252 None] Detach volume completed successfully.
Jul 16 21:55:46.269041 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8969d9a5-832a-49ae-bab7-a03fa051b8b2 tempest-VolumesActionsTest-2140470252 None] Lock "cinder-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a-detach_volume" released by "detach_volume" :: held 0.195s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:55:46.402504 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-dff52eaf-3699-4faf-a400-8c9f65985572 tempest-VolumesActionsTest-763750246 None] Acquiring lock "cinder-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a-detach_volume" by "detach_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:55:46.411970 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-dff52eaf-3699-4faf-a400-8c9f65985572 tempest-VolumesActionsTest-763750246 None] Lock "cinder-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:55:46.412389 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-dff52eaf-3699-4faf-a400-8c9f65985572 tempest-VolumesActionsTest-763750246 None] Volume detach called, but volume not attached.
Jul 16 21:55:46.423497 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-dff52eaf-3699-4faf-a400-8c9f65985572 tempest-VolumesActionsTest-763750246 None] Lock "cinder-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a-detach_volume" released by "detach_volume" :: held 0.011s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:55:50.950155 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:55:50.969091 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Flow 'volume_create_manager' (20b15fa4-3763-490c-b64c-6fd4e73746d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:55:50.975976 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00abb03d-d85d-4bdd-b302-1693a466bdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:50.992626 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00abb03d-d85d-4bdd-b302-1693a466bdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-609702212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6a3c9be1-4eb5-47c9-aeb2-216573a3c072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ce121469a145a4b00edd3a082413a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:55:51Z,use_quota=True,user_id='2331af9efc5e4af7a901621b7590e80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:50.997808 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8c21f8-f905-4a30-b944-c983506a55f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:51.001892 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8c21f8-f905-4a30-b944-c983506a55f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:51.006910 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0bb8fd-ab4b-45f3-a6bc-7b5f690e76af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:51.010802 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0bb8fd-ab4b-45f3-a6bc-7b5f690e76af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a3c9be1-4eb5-47c9-aeb2-216573a3c072', 'volume_name': 'volume-6a3c9be1-4eb5-47c9-aeb2-216573a3c072', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:51.020890 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668b4417-0d0c-4f6e-bff6-e8627df91cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:51.020890 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668b4417-0d0c-4f6e-bff6-e8627df91cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:51.024154 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46678fc3-161e-4c34-9047-735a65dc6e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:51.025199 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Volume 6a3c9be1-4eb5-47c9-aeb2-216573a3c072: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a3c9be1-4eb5-47c9-aeb2-216573a3c072', 'volume_size': 1}
Jul 16 21:55:51.025589 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] creating volume 'volume-6a3c9be1-4eb5-47c9-aeb2-216573a3c072' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:55:51.026225 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:55:51.398199 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:55:51.398572 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:55:51.402171 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46678fc3-161e-4c34-9047-735a65dc6e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a3c9be1-4eb5-47c9-aeb2-216573a3c072', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:51.406592 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9c154f-a960-41e6-b036-7689dd20b3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:51.457421 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Volume volume-6a3c9be1-4eb5-47c9-aeb2-216573a3c072 (6a3c9be1-4eb5-47c9-aeb2-216573a3c072): created successfully
Jul 16 21:55:51.460986 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9c154f-a960-41e6-b036-7689dd20b3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:51.466410 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Flow 'volume_create_manager' (20b15fa4-3763-490c-b64c-6fd4e73746d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:55:51.520215 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-50d889a5-ba4d-45d1-915a-7eb3d32ed151 tempest-VolumesActionsTest-763750246 None] Created volume successfully.
Jul 16 21:55:52.155210 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-1f0a92be-e599-4fa8-97d0-144da3679f56 tempest-VolumesActionsTest-2140470252 None] Acquiring lock "cinder-6a3c9be1-4eb5-47c9-aeb2-216573a3c072-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:55:52.164360 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-1f0a92be-e599-4fa8-97d0-144da3679f56 tempest-VolumesActionsTest-2140470252 None] Lock "cinder-6a3c9be1-4eb5-47c9-aeb2-216573a3c072-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:55:52.248407 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1f0a92be-e599-4fa8-97d0-144da3679f56 tempest-VolumesActionsTest-2140470252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:55:52.343355 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1f0a92be-e599-4fa8-97d0-144da3679f56 tempest-VolumesActionsTest-2140470252 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:55:52.343783 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1f0a92be-e599-4fa8-97d0-144da3679f56 tempest-VolumesActionsTest-2140470252 None] Volume volume-6a3c9be1-4eb5-47c9-aeb2-216573a3c072 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:55:52.400797 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1f0a92be-e599-4fa8-97d0-144da3679f56 tempest-VolumesActionsTest-2140470252 None] deleting rbd volume volume-6a3c9be1-4eb5-47c9-aeb2-216573a3c072 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:55:54.583603 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-1f0a92be-e599-4fa8-97d0-144da3679f56 tempest-VolumesActionsTest-2140470252 None] Created reservations ['c37bbde5-c620-40a7-a964-1783ae0a69c1', 'cfab21df-3b22-4688-8f35-f5eb4d6efd60', '63ea7549-5c1f-412c-8ccd-50a65875f4a2', 'df49c059-9bf3-4040-a11d-f06e964c0888'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:55:54.749548 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1f0a92be-e599-4fa8-97d0-144da3679f56 tempest-VolumesActionsTest-2140470252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:55:54.773307 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-1f0a92be-e599-4fa8-97d0-144da3679f56 tempest-VolumesActionsTest-2140470252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:55:54.797700 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-1f0a92be-e599-4fa8-97d0-144da3679f56 tempest-VolumesActionsTest-2140470252 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:55:54.802081 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-1f0a92be-e599-4fa8-97d0-144da3679f56 tempest-VolumesActionsTest-2140470252 None] Deleted volume successfully.
Jul 16 21:55:54.867492 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-1f0a92be-e599-4fa8-97d0-144da3679f56 tempest-VolumesActionsTest-2140470252 None] Lock "cinder-6a3c9be1-4eb5-47c9-aeb2-216573a3c072-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:55:55.973988 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:55:55.995711 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Flow 'volume_create_manager' (25a73914-222d-47c9-96ca-34d69568a503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:55:56.002075 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878fdaf3-9edb-4b09-bad4-a6c07bf4eab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:56.023923 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878fdaf3-9edb-4b09-bad4-a6c07bf4eab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-761391402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1d81e698-1dad-46f2-9428-6ca80a272451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ce121469a145a4b00edd3a082413a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:55:56Z,use_quota=True,user_id='2331af9efc5e4af7a901621b7590e80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:56.029131 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3166076e-a47e-438b-b9c2-575762697c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:56.033102 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3166076e-a47e-438b-b9c2-575762697c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:56.038658 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73539d3f-df70-44e2-8610-b6822daa72cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:56.042580 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73539d3f-df70-44e2-8610-b6822daa72cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d81e698-1dad-46f2-9428-6ca80a272451', 'volume_name': 'volume-1d81e698-1dad-46f2-9428-6ca80a272451', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:56.047274 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f26882-3acc-4b73-8256-fb0159d61343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:56.051885 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f26882-3acc-4b73-8256-fb0159d61343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:56.056365 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d4affd-b4ba-4997-9644-9b7da8a6f7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:56.057384 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Volume 1d81e698-1dad-46f2-9428-6ca80a272451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d81e698-1dad-46f2-9428-6ca80a272451', 'volume_size': 1}
Jul 16 21:55:56.057767 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] creating volume 'volume-1d81e698-1dad-46f2-9428-6ca80a272451' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:55:56.058508 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:55:56.398576 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:55:56.398951 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:55:56.402710 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d4affd-b4ba-4997-9644-9b7da8a6f7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d81e698-1dad-46f2-9428-6ca80a272451', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:56.407262 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dbdf861-5f74-4bc7-8e21-06a4620bf641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:55:56.474647 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Volume volume-1d81e698-1dad-46f2-9428-6ca80a272451 (1d81e698-1dad-46f2-9428-6ca80a272451): created successfully
Jul 16 21:55:56.478133 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dbdf861-5f74-4bc7-8e21-06a4620bf641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:55:56.483650 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Flow 'volume_create_manager' (25a73914-222d-47c9-96ca-34d69568a503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:55:56.486606 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=37,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:55:56.611562 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-31b0669c-d706-419c-9a0e-36e5d053edd8 tempest-VolumesActionsTest-763750246 None] Created volume successfully.
Jul 16 21:55:57.149548 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-0638357f-6fb7-4c1a-b480-31e066c54173 tempest-VolumesActionsTest-2140470252 None] Acquiring lock "cinder-1d81e698-1dad-46f2-9428-6ca80a272451-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:55:57.158688 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-0638357f-6fb7-4c1a-b480-31e066c54173 tempest-VolumesActionsTest-2140470252 None] Lock "cinder-1d81e698-1dad-46f2-9428-6ca80a272451-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:55:57.218148 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0638357f-6fb7-4c1a-b480-31e066c54173 tempest-VolumesActionsTest-2140470252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:55:57.314353 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0638357f-6fb7-4c1a-b480-31e066c54173 tempest-VolumesActionsTest-2140470252 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:55:57.314782 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0638357f-6fb7-4c1a-b480-31e066c54173 tempest-VolumesActionsTest-2140470252 None] Volume volume-1d81e698-1dad-46f2-9428-6ca80a272451 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:55:57.428966 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0638357f-6fb7-4c1a-b480-31e066c54173 tempest-VolumesActionsTest-2140470252 None] deleting rbd volume volume-1d81e698-1dad-46f2-9428-6ca80a272451 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:55:59.137329 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-0638357f-6fb7-4c1a-b480-31e066c54173 tempest-VolumesActionsTest-2140470252 None] Created reservations ['a013ece1-65fc-4a76-9564-5b15072d57b4', 'a863219d-509b-487a-ac9f-f70a4f8ceae1', 'bceead27-f137-4729-8de1-6c944d78efb6', '26c96fc6-463b-4b2b-9198-44e95f325906'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:55:59.338387 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0638357f-6fb7-4c1a-b480-31e066c54173 tempest-VolumesActionsTest-2140470252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:55:59.396231 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-0638357f-6fb7-4c1a-b480-31e066c54173 tempest-VolumesActionsTest-2140470252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:55:59.420741 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-0638357f-6fb7-4c1a-b480-31e066c54173 tempest-VolumesActionsTest-2140470252 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:55:59.424823 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-0638357f-6fb7-4c1a-b480-31e066c54173 tempest-VolumesActionsTest-2140470252 None] Deleted volume successfully.
Jul 16 21:55:59.513470 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-0638357f-6fb7-4c1a-b480-31e066c54173 tempest-VolumesActionsTest-2140470252 None] Lock "cinder-1d81e698-1dad-46f2-9428-6ca80a272451-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:56:00.006944 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:56:00.026300 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Flow 'volume_create_manager' (88a7ec18-084c-43ca-971d-8aa46d726e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:00.032700 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0231296a-d9a0-4060-af5c-0b78a0ab16bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:00.049680 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0231296a-d9a0-4060-af5c-0b78a0ab16bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1321707072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=80f87625-05fd-4cfa-92d8-9b5f2d83d6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ce121469a145a4b00edd3a082413a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:56:00Z,use_quota=True,user_id='2331af9efc5e4af7a901621b7590e80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:00.055584 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9281af32-f5c6-497c-a465-7cb76af6ba58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:00.059668 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9281af32-f5c6-497c-a465-7cb76af6ba58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:00.064664 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4306e70-4f9a-448a-b132-2ee92cf0d056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:00.069345 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4306e70-4f9a-448a-b132-2ee92cf0d056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f87625-05fd-4cfa-92d8-9b5f2d83d6bc', 'volume_name': 'volume-80f87625-05fd-4cfa-92d8-9b5f2d83d6bc', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:00.074191 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d317e5-8f2b-4ca7-8580-13cd0a97533d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:00.078047 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d317e5-8f2b-4ca7-8580-13cd0a97533d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:00.083002 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d327ba7-19d3-48c2-a880-37e7d4dde259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:00.084086 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Volume 80f87625-05fd-4cfa-92d8-9b5f2d83d6bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f87625-05fd-4cfa-92d8-9b5f2d83d6bc', 'volume_size': 1}
Jul 16 21:56:00.084479 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] creating volume 'volume-80f87625-05fd-4cfa-92d8-9b5f2d83d6bc' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:56:00.085234 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:00.391976 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:56:00.392632 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:56:00.397206 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d327ba7-19d3-48c2-a880-37e7d4dde259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f87625-05fd-4cfa-92d8-9b5f2d83d6bc', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:00.401687 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11b0d08-196a-4e7b-b068-1f0473fb1f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:00.474643 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Volume volume-80f87625-05fd-4cfa-92d8-9b5f2d83d6bc (80f87625-05fd-4cfa-92d8-9b5f2d83d6bc): created successfully
Jul 16 21:56:00.478149 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11b0d08-196a-4e7b-b068-1f0473fb1f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:00.483535 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Flow 'volume_create_manager' (88a7ec18-084c-43ca-971d-8aa46d726e49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:00.594422 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-014cffdf-90d2-42bd-a663-5614d0fc16ae tempest-VolumesActionsTest-763750246 None] Created volume successfully.
Jul 16 21:56:01.217915 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-c3eb34ae-ee9f-46d0-a651-ab9325526997 tempest-VolumesActionsTest-2140470252 None] Acquiring lock "cinder-80f87625-05fd-4cfa-92d8-9b5f2d83d6bc-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:56:01.228423 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-c3eb34ae-ee9f-46d0-a651-ab9325526997 tempest-VolumesActionsTest-2140470252 None] Lock "cinder-80f87625-05fd-4cfa-92d8-9b5f2d83d6bc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:56:01.298005 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c3eb34ae-ee9f-46d0-a651-ab9325526997 tempest-VolumesActionsTest-2140470252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:01.371233 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c3eb34ae-ee9f-46d0-a651-ab9325526997 tempest-VolumesActionsTest-2140470252 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:56:01.371658 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c3eb34ae-ee9f-46d0-a651-ab9325526997 tempest-VolumesActionsTest-2140470252 None] Volume volume-80f87625-05fd-4cfa-92d8-9b5f2d83d6bc is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:56:01.406081 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c3eb34ae-ee9f-46d0-a651-ab9325526997 tempest-VolumesActionsTest-2140470252 None] deleting rbd volume volume-80f87625-05fd-4cfa-92d8-9b5f2d83d6bc {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:56:03.240015 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-c3eb34ae-ee9f-46d0-a651-ab9325526997 tempest-VolumesActionsTest-2140470252 None] Created reservations ['c6a7e2d7-c07f-41d4-b15c-849c1eab51d7', '235bd562-e1c4-44b0-9506-15d05dc2d192', 'f1dc922f-7493-4f7b-9a13-6f181f427e69', '291d93b0-88ab-4d7c-af25-69beef23691d'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:56:03.246451 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=29,cinder:SELECT=61,cinder:INSERT=8,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:56:03.429305 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c3eb34ae-ee9f-46d0-a651-ab9325526997 tempest-VolumesActionsTest-2140470252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:03.452722 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c3eb34ae-ee9f-46d0-a651-ab9325526997 tempest-VolumesActionsTest-2140470252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:03.478058 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-c3eb34ae-ee9f-46d0-a651-ab9325526997 tempest-VolumesActionsTest-2140470252 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:56:03.481975 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-c3eb34ae-ee9f-46d0-a651-ab9325526997 tempest-VolumesActionsTest-2140470252 None] Deleted volume successfully.
Jul 16 21:56:03.559225 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-c3eb34ae-ee9f-46d0-a651-ab9325526997 tempest-VolumesActionsTest-2140470252 None] Lock "cinder-80f87625-05fd-4cfa-92d8-9b5f2d83d6bc-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:56:05.225000 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:56:05.243928 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Flow 'volume_create_manager' (f66d45db-7b3b-494a-9e9f-2fc28d8c13ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:05.250185 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14755883-c307-4743-8d53-920d3050ad04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:05.266061 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14755883-c307-4743-8d53-920d3050ad04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-922265629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1bd27e36-f726-4106-ac22-66374ddf5148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ce121469a145a4b00edd3a082413a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:56:05Z,use_quota=True,user_id='2331af9efc5e4af7a901621b7590e80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:05.271894 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c84305c-fbcd-4b51-9334-bd69a633b0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:05.275932 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c84305c-fbcd-4b51-9334-bd69a633b0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:05.280882 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83dd5fb2-363b-4adf-b396-2cdfe2dfa2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:05.285409 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83dd5fb2-363b-4adf-b396-2cdfe2dfa2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bd27e36-f726-4106-ac22-66374ddf5148', 'volume_name': 'volume-1bd27e36-f726-4106-ac22-66374ddf5148', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:05.290169 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9555db03-6aed-449f-9780-2eaded56aa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:05.294001 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9555db03-6aed-449f-9780-2eaded56aa20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:05.298713 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebef267-0437-4c4c-9165-a6dd00e9360b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:05.299784 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Volume 1bd27e36-f726-4106-ac22-66374ddf5148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bd27e36-f726-4106-ac22-66374ddf5148', 'volume_size': 1}
Jul 16 21:56:05.300198 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] creating volume 'volume-1bd27e36-f726-4106-ac22-66374ddf5148' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:56:05.300945 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:05.580734 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:56:05.581171 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:56:05.584958 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebef267-0437-4c4c-9165-a6dd00e9360b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bd27e36-f726-4106-ac22-66374ddf5148', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:05.589447 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306ee522-77a1-4190-95f8-1e0cff77f4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:05.651609 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Volume volume-1bd27e36-f726-4106-ac22-66374ddf5148 (1bd27e36-f726-4106-ac22-66374ddf5148): created successfully
Jul 16 21:56:05.655192 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306ee522-77a1-4190-95f8-1e0cff77f4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:05.661037 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Flow 'volume_create_manager' (f66d45db-7b3b-494a-9e9f-2fc28d8c13ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:05.714330 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-3503a802-edaa-407b-8b95-18d6e7b39030 tempest-VolumesActionsTest-763750246 None] Created volume successfully.
Jul 16 21:56:06.379357 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-185fdab5-dd5e-4d8d-b6cd-a46d2be424a2 tempest-VolumesActionsTest-2140470252 None] Acquiring lock "cinder-1bd27e36-f726-4106-ac22-66374ddf5148-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:56:06.390389 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-185fdab5-dd5e-4d8d-b6cd-a46d2be424a2 tempest-VolumesActionsTest-2140470252 None] Lock "cinder-1bd27e36-f726-4106-ac22-66374ddf5148-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:56:06.498460 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-185fdab5-dd5e-4d8d-b6cd-a46d2be424a2 tempest-VolumesActionsTest-2140470252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:06.628015 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-185fdab5-dd5e-4d8d-b6cd-a46d2be424a2 tempest-VolumesActionsTest-2140470252 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:56:06.628444 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-185fdab5-dd5e-4d8d-b6cd-a46d2be424a2 tempest-VolumesActionsTest-2140470252 None] Volume volume-1bd27e36-f726-4106-ac22-66374ddf5148 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:56:06.685808 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-185fdab5-dd5e-4d8d-b6cd-a46d2be424a2 tempest-VolumesActionsTest-2140470252 None] deleting rbd volume volume-1bd27e36-f726-4106-ac22-66374ddf5148 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:56:08.485913 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-185fdab5-dd5e-4d8d-b6cd-a46d2be424a2 tempest-VolumesActionsTest-2140470252 None] Created reservations ['37df9f47-08ae-4033-b977-6c2b92019c4b', 'af829e36-03de-48f1-abb7-62cac4afdd5a', '2d1b2b4b-5a4a-4d00-9d59-3b11ad6ffd3f', '6cc56104-6d87-4e62-825f-4c9ebcbf9527'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:56:08.612209 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-185fdab5-dd5e-4d8d-b6cd-a46d2be424a2 tempest-VolumesActionsTest-2140470252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:08.636670 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-185fdab5-dd5e-4d8d-b6cd-a46d2be424a2 tempest-VolumesActionsTest-2140470252 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:08.661870 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-185fdab5-dd5e-4d8d-b6cd-a46d2be424a2 tempest-VolumesActionsTest-2140470252 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:56:08.666137 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-185fdab5-dd5e-4d8d-b6cd-a46d2be424a2 tempest-VolumesActionsTest-2140470252 None] Deleted volume successfully.
Jul 16 21:56:08.712687 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-185fdab5-dd5e-4d8d-b6cd-a46d2be424a2 tempest-VolumesActionsTest-2140470252 None] Lock "cinder-1bd27e36-f726-4106-ac22-66374ddf5148-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:56:10.196159 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:56:10.215726 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Flow 'volume_create_manager' (33b2f7d9-7b5f-4c4e-a997-9ba6e28ebb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:10.222839 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1fcabc-e80b-48b9-8984-3dbc85c476f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:10.238366 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1fcabc-e80b-48b9-8984-3dbc85c476f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1512261298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=bcebbb54-3984-4b63-bc7e-1628b01c21b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ce121469a145a4b00edd3a082413a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:56:10Z,use_quota=True,user_id='2331af9efc5e4af7a901621b7590e80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:10.243634 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6358b7-f415-4391-a08e-dbe84f55af9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:10.247678 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6358b7-f415-4391-a08e-dbe84f55af9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:10.252608 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd33838-a5fb-4d0f-af30-972a4f71f2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:10.257094 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd33838-a5fb-4d0f-af30-972a4f71f2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcebbb54-3984-4b63-bc7e-1628b01c21b3', 'volume_name': 'volume-bcebbb54-3984-4b63-bc7e-1628b01c21b3', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:10.261831 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b39c2f1-ab91-413f-88b2-5daa0bb942ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:10.265632 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b39c2f1-ab91-413f-88b2-5daa0bb942ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:10.270764 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa4c2313-59ca-4c43-8920-d2f3d7f5419c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:10.271853 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Volume bcebbb54-3984-4b63-bc7e-1628b01c21b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcebbb54-3984-4b63-bc7e-1628b01c21b3', 'volume_size': 1}
Jul 16 21:56:10.272223 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] creating volume 'volume-bcebbb54-3984-4b63-bc7e-1628b01c21b3' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:56:10.273050 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:10.757861 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:56:10.758246 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:56:10.761955 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa4c2313-59ca-4c43-8920-d2f3d7f5419c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcebbb54-3984-4b63-bc7e-1628b01c21b3', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:10.766730 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feefd9d6-e362-4661-aec0-c76305d78e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:10.840201 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Volume volume-bcebbb54-3984-4b63-bc7e-1628b01c21b3 (bcebbb54-3984-4b63-bc7e-1628b01c21b3): created successfully
Jul 16 21:56:10.844084 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feefd9d6-e362-4661-aec0-c76305d78e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:10.850570 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Flow 'volume_create_manager' (33b2f7d9-7b5f-4c4e-a997-9ba6e28ebb51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:10.914363 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-69b52fc3-22a7-4c6f-97ca-4d26b5ac55dd tempest-VolumesActionsTest-763750246 None] Created volume successfully.
Jul 16 21:56:11.979876 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5e85cf52-c5b7-4900-8855-e3c4d45b8323 tempest-VolumesActionsTest-763750246 None] Acquiring lock "cinder-bcebbb54-3984-4b63-bc7e-1628b01c21b3-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:56:11.987941 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5e85cf52-c5b7-4900-8855-e3c4d45b8323 tempest-VolumesActionsTest-763750246 None] Lock "cinder-bcebbb54-3984-4b63-bc7e-1628b01c21b3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:56:12.046185 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5e85cf52-c5b7-4900-8855-e3c4d45b8323 tempest-VolumesActionsTest-763750246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:12.131406 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5e85cf52-c5b7-4900-8855-e3c4d45b8323 tempest-VolumesActionsTest-763750246 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:56:12.131831 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5e85cf52-c5b7-4900-8855-e3c4d45b8323 tempest-VolumesActionsTest-763750246 None] Volume volume-bcebbb54-3984-4b63-bc7e-1628b01c21b3 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:56:12.217993 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5e85cf52-c5b7-4900-8855-e3c4d45b8323 tempest-VolumesActionsTest-763750246 None] deleting rbd volume volume-bcebbb54-3984-4b63-bc7e-1628b01c21b3 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:56:14.016948 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=54,cinder:INSERT=6,cinder:UPDATE=35,cinder:DELETE=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:56:14.102916 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-5e85cf52-c5b7-4900-8855-e3c4d45b8323 tempest-VolumesActionsTest-763750246 None] Created reservations ['9c259998-0d3b-4423-b575-5cad99be780e', 'c946676f-4913-4e72-bdc7-2c64cfcac39f', '69e3a715-6b17-4ecc-863e-5b745ded06a2', 'f716ce7c-679c-4bc4-a931-81c1f4e95044'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:56:14.274533 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5e85cf52-c5b7-4900-8855-e3c4d45b8323 tempest-VolumesActionsTest-763750246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:14.297368 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-5e85cf52-c5b7-4900-8855-e3c4d45b8323 tempest-VolumesActionsTest-763750246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:14.321776 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-5e85cf52-c5b7-4900-8855-e3c4d45b8323 tempest-VolumesActionsTest-763750246 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:56:14.325835 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-5e85cf52-c5b7-4900-8855-e3c4d45b8323 tempest-VolumesActionsTest-763750246 None] Deleted volume successfully.
Jul 16 21:56:14.401707 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-5e85cf52-c5b7-4900-8855-e3c4d45b8323 tempest-VolumesActionsTest-763750246 None] Lock "cinder-bcebbb54-3984-4b63-bc7e-1628b01c21b3-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:56:15.403528 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b043c30b-e7a4-47d5-ae72-38898e1db014 tempest-VolumesActionsTest-763750246 None] Acquiring lock "cinder-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:56:15.413273 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b043c30b-e7a4-47d5-ae72-38898e1db014 tempest-VolumesActionsTest-763750246 None] Lock "cinder-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:56:15.496840 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b043c30b-e7a4-47d5-ae72-38898e1db014 tempest-VolumesActionsTest-763750246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:15.593775 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b043c30b-e7a4-47d5-ae72-38898e1db014 tempest-VolumesActionsTest-763750246 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:56:15.594194 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b043c30b-e7a4-47d5-ae72-38898e1db014 tempest-VolumesActionsTest-763750246 None] Volume volume-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:56:15.640158 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b043c30b-e7a4-47d5-ae72-38898e1db014 tempest-VolumesActionsTest-763750246 None] deleting rbd volume volume-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:56:18.028512 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-b043c30b-e7a4-47d5-ae72-38898e1db014 tempest-VolumesActionsTest-763750246 None] Created reservations ['bb27541f-89bd-4b27-9739-0acb377091e8', 'd25ff42f-02e4-4428-8ce6-e59b683f8795', 'fa19a7ec-d3d8-48e3-ac0a-e51484a6cab4', '47124557-2e9e-4cfe-a4d2-c24fdaf04f3f'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:56:18.143114 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b043c30b-e7a4-47d5-ae72-38898e1db014 tempest-VolumesActionsTest-763750246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:18.168468 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b043c30b-e7a4-47d5-ae72-38898e1db014 tempest-VolumesActionsTest-763750246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:18.192776 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-b043c30b-e7a4-47d5-ae72-38898e1db014 tempest-VolumesActionsTest-763750246 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:56:18.202116 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b043c30b-e7a4-47d5-ae72-38898e1db014 tempest-VolumesActionsTest-763750246 None] Deleted volume successfully.
Jul 16 21:56:18.250628 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-b043c30b-e7a4-47d5-ae72-38898e1db014 tempest-VolumesActionsTest-763750246 None] Lock "cinder-948e8fb3-4fe8-4dc5-8e47-8f6c6aa23a0a-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:56:24.829870 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:56:24.849562 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Flow 'volume_create_manager' (7234fe23-d499-416d-8c59-2de60b49a0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:24.856500 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5dc9bdd-cefd-4e7a-85ee-18a88373e264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:24.872623 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5dc9bdd-cefd-4e7a-85ee-18a88373e264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1867808371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=eb47c488-aee2-498d-82cd-28a86b48f674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f2097315dd4040b0b28dc8be492447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:56:25Z,use_quota=True,user_id='f1beaafe410448dc8e79b533e76073a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:24.877841 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1631889b-1701-4744-ae48-0dea83bfff6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:24.882106 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1631889b-1701-4744-ae48-0dea83bfff6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:24.887106 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4feaae80-d223-4d33-899b-583d857b58b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:24.891097 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4feaae80-d223-4d33-899b-583d857b58b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb47c488-aee2-498d-82cd-28a86b48f674', 'volume_name': 'volume-eb47c488-aee2-498d-82cd-28a86b48f674', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:24.895876 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42b06ed-f471-4427-b71f-71749a635af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:24.900419 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42b06ed-f471-4427-b71f-71749a635af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:24.904981 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f54644e-174f-407a-bdf8-f61e6511bd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:24.906030 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Volume eb47c488-aee2-498d-82cd-28a86b48f674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb47c488-aee2-498d-82cd-28a86b48f674', 'volume_size': 1}
Jul 16 21:56:24.906420 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] creating volume 'volume-eb47c488-aee2-498d-82cd-28a86b48f674' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:56:24.907197 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:25.232000 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:56:25.232288 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:56:25.236132 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f54644e-174f-407a-bdf8-f61e6511bd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb47c488-aee2-498d-82cd-28a86b48f674', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:25.240650 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0888fd5-b9de-43fe-9162-bc49ecbd5bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:25.296925 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Volume volume-eb47c488-aee2-498d-82cd-28a86b48f674 (eb47c488-aee2-498d-82cd-28a86b48f674): created successfully
Jul 16 21:56:25.300618 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0888fd5-b9de-43fe-9162-bc49ecbd5bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:25.306664 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Flow 'volume_create_manager' (7234fe23-d499-416d-8c59-2de60b49a0ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:25.310532 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=56,cinder:UPDATE=32,cinder:INSERT=9,cinder:DELETE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:56:25.388282 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-28291df9-7abc-4663-8923-48160e05713e tempest-VolumesTransfersV355Test-72977723 None] Created volume successfully.
Jul 16 21:56:26.742228 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-11e9e919-81f6-4c0a-b1d0-e934820bd3a9 tempest-VolumesTransfersV355Test-995060937 None] Transfer volume completed successfully.
Jul 16 21:56:27.560407 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-df155164-ff8d-4719-b110-01f32b9a6201 tempest-VolumesTransfersV355Test-1278971708 None] Acquiring lock "cinder-eb47c488-aee2-498d-82cd-28a86b48f674-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:56:27.569872 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-df155164-ff8d-4719-b110-01f32b9a6201 tempest-VolumesTransfersV355Test-1278971708 None] Lock "cinder-eb47c488-aee2-498d-82cd-28a86b48f674-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:56:27.659141 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-df155164-ff8d-4719-b110-01f32b9a6201 tempest-VolumesTransfersV355Test-1278971708 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:27.753397 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-df155164-ff8d-4719-b110-01f32b9a6201 tempest-VolumesTransfersV355Test-1278971708 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:56:27.753983 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-df155164-ff8d-4719-b110-01f32b9a6201 tempest-VolumesTransfersV355Test-1278971708 None] Volume volume-eb47c488-aee2-498d-82cd-28a86b48f674 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:56:27.805465 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-df155164-ff8d-4719-b110-01f32b9a6201 tempest-VolumesTransfersV355Test-1278971708 None] deleting rbd volume volume-eb47c488-aee2-498d-82cd-28a86b48f674 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:56:29.468347 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-df155164-ff8d-4719-b110-01f32b9a6201 tempest-VolumesTransfersV355Test-1278971708 None] Created reservations ['c469d396-1a3e-4381-8286-27ce69179695', 'c8147b89-0e0f-4540-8e71-c4ee6458c46a', 'f029b30e-9f7c-4393-ae46-4182e25104b3', '7a872db1-643b-4041-8163-463252acecf1'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:56:29.617152 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-df155164-ff8d-4719-b110-01f32b9a6201 tempest-VolumesTransfersV355Test-1278971708 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:29.640862 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-df155164-ff8d-4719-b110-01f32b9a6201 tempest-VolumesTransfersV355Test-1278971708 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:29.669021 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-df155164-ff8d-4719-b110-01f32b9a6201 tempest-VolumesTransfersV355Test-1278971708 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:56:29.673025 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-df155164-ff8d-4719-b110-01f32b9a6201 tempest-VolumesTransfersV355Test-1278971708 None] Deleted volume successfully.
Jul 16 21:56:29.737856 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-df155164-ff8d-4719-b110-01f32b9a6201 tempest-VolumesTransfersV355Test-1278971708 None] Lock "cinder-eb47c488-aee2-498d-82cd-28a86b48f674-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:56:30.429961 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:56:30.450502 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Flow 'volume_create_manager' (a93b0d0a-af0f-4d7f-9508-60554b17faeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:30.456634 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277ae7a0-3c75-4d7f-b663-51a461f1a660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:30.472801 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277ae7a0-3c75-4d7f-b663-51a461f1a660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-958074826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=287d1c1d-18e1-43b3-ab22-ea6a3318ecd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f2097315dd4040b0b28dc8be492447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:56:30Z,use_quota=True,user_id='f1beaafe410448dc8e79b533e76073a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:30.478627 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c76b7a7-a4fe-4832-901c-36b80c3e02b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:30.482694 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c76b7a7-a4fe-4832-901c-36b80c3e02b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:30.487600 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57240221-a9e0-456f-84f9-08f582734ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:30.492147 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57240221-a9e0-456f-84f9-08f582734ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287d1c1d-18e1-43b3-ab22-ea6a3318ecd1', 'volume_name': 'volume-287d1c1d-18e1-43b3-ab22-ea6a3318ecd1', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:30.496902 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680df583-d9e9-4ea2-8b30-6918bfd74e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:30.500614 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680df583-d9e9-4ea2-8b30-6918bfd74e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:30.505126 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cd88cb-21c7-4328-ab09-9061af9b6f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:30.506160 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Volume 287d1c1d-18e1-43b3-ab22-ea6a3318ecd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287d1c1d-18e1-43b3-ab22-ea6a3318ecd1', 'volume_size': 1}
Jul 16 21:56:30.506573 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] creating volume 'volume-287d1c1d-18e1-43b3-ab22-ea6a3318ecd1' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:56:30.507335 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:30.813919 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:56:30.814294 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:56:30.817998 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cd88cb-21c7-4328-ab09-9061af9b6f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287d1c1d-18e1-43b3-ab22-ea6a3318ecd1', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:30.822649 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3f8ab3-015d-4c2f-b7a5-cb88b1dd725c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:30.868090 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Volume volume-287d1c1d-18e1-43b3-ab22-ea6a3318ecd1 (287d1c1d-18e1-43b3-ab22-ea6a3318ecd1): created successfully
Jul 16 21:56:30.871695 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3f8ab3-015d-4c2f-b7a5-cb88b1dd725c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:30.877339 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Flow 'volume_create_manager' (a93b0d0a-af0f-4d7f-9508-60554b17faeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:30.930596 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-ff4f1818-a90a-42dd-99aa-7c57cc3e10f4 tempest-VolumesTransfersV355Test-72977723 None] Created volume successfully.
Jul 16 21:56:31.858339 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e3fc0d67-aae5-4bb0-99fc-4139d5bfaeb0 tempest-VolumesTransfersV355Test-1278971708 None] Acquiring lock "cinder-287d1c1d-18e1-43b3-ab22-ea6a3318ecd1-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:56:31.869983 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e3fc0d67-aae5-4bb0-99fc-4139d5bfaeb0 tempest-VolumesTransfersV355Test-1278971708 None] Lock "cinder-287d1c1d-18e1-43b3-ab22-ea6a3318ecd1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:56:31.949649 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e3fc0d67-aae5-4bb0-99fc-4139d5bfaeb0 tempest-VolumesTransfersV355Test-1278971708 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:32.033613 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e3fc0d67-aae5-4bb0-99fc-4139d5bfaeb0 tempest-VolumesTransfersV355Test-1278971708 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:56:32.034129 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e3fc0d67-aae5-4bb0-99fc-4139d5bfaeb0 tempest-VolumesTransfersV355Test-1278971708 None] Volume volume-287d1c1d-18e1-43b3-ab22-ea6a3318ecd1 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:56:32.074227 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e3fc0d67-aae5-4bb0-99fc-4139d5bfaeb0 tempest-VolumesTransfersV355Test-1278971708 None] deleting rbd volume volume-287d1c1d-18e1-43b3-ab22-ea6a3318ecd1 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:56:34.091158 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-e3fc0d67-aae5-4bb0-99fc-4139d5bfaeb0 tempest-VolumesTransfersV355Test-1278971708 None] Created reservations ['f99aaf5b-676f-415b-8e4c-d41465a7436c', '0ad4846f-82a6-4141-9660-6257277c0daf', '47986407-2233-47af-840e-edef6248fa3c', '64356b18-7b1c-4f65-9bfd-f48ed61e8544'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:56:34.212155 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e3fc0d67-aae5-4bb0-99fc-4139d5bfaeb0 tempest-VolumesTransfersV355Test-1278971708 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:34.237527 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e3fc0d67-aae5-4bb0-99fc-4139d5bfaeb0 tempest-VolumesTransfersV355Test-1278971708 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:34.261557 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-e3fc0d67-aae5-4bb0-99fc-4139d5bfaeb0 tempest-VolumesTransfersV355Test-1278971708 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:56:34.265480 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e3fc0d67-aae5-4bb0-99fc-4139d5bfaeb0 tempest-VolumesTransfersV355Test-1278971708 None] Deleted volume successfully.
Jul 16 21:56:34.317730 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e3fc0d67-aae5-4bb0-99fc-4139d5bfaeb0 tempest-VolumesTransfersV355Test-1278971708 None] Lock "cinder-287d1c1d-18e1-43b3-ab22-ea6a3318ecd1-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:56:38.421621 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:56:38.422308 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:38.447941 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:38.479038 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:56:39.961119 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:56:39.982646 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Flow 'volume_create_manager' (5a5dc2dc-b660-4f39-99e7-1874b41eed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:39.989076 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b12de9-3f11-4e22-8bbd-b649e820e084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:40.005049 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b12de9-3f11-4e22-8bbd-b649e820e084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-575031597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=45069e67-40e7-4af2-b06b-93a4e57d3a95,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8b7e87a189654e559ead7f80ac37a90e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:56:40Z,use_quota=True,user_id='1e94e88f6c7c425aa1cae382f638ea96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:40.010723 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1791a4d-61ff-4384-98c0-a625a5dd0873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:40.014779 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1791a4d-61ff-4384-98c0-a625a5dd0873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:40.019788 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d77fdd9-da07-45b2-a4b0-e791954221b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:40.024619 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d77fdd9-da07-45b2-a4b0-e791954221b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45069e67-40e7-4af2-b06b-93a4e57d3a95', 'volume_name': 'volume-45069e67-40e7-4af2-b06b-93a4e57d3a95', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:40.029447 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355dfb07-53a3-4e9e-b973-d1eec2a0d2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:40.033273 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355dfb07-53a3-4e9e-b973-d1eec2a0d2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:40.037905 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc9fb29-0c11-4530-ad5a-ea418f93c6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:40.039817 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Volume 45069e67-40e7-4af2-b06b-93a4e57d3a95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45069e67-40e7-4af2-b06b-93a4e57d3a95', 'volume_size': 1}
Jul 16 21:56:40.039962 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] creating volume 'volume-45069e67-40e7-4af2-b06b-93a4e57d3a95' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:56:40.040710 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:40.340519 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:56:40.340893 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:56:40.344849 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc9fb29-0c11-4530-ad5a-ea418f93c6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45069e67-40e7-4af2-b06b-93a4e57d3a95', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:40.349300 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8318f90-b443-4d09-b075-7bef8358911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:40.404781 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Volume volume-45069e67-40e7-4af2-b06b-93a4e57d3a95 (45069e67-40e7-4af2-b06b-93a4e57d3a95): created successfully
Jul 16 21:56:40.408338 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8318f90-b443-4d09-b075-7bef8358911f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:40.413717 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Flow 'volume_create_manager' (5a5dc2dc-b660-4f39-99e7-1874b41eed55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:40.490470 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-2993e967-ceb0-4df0-bc8b-61b84ef04146 tempest-VolumesGetTest-1454868418 None] Created volume successfully.
Jul 16 21:56:41.909123 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:56:41.928210 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Flow 'volume_create_manager' (fe50270b-a999-43ea-91c7-762ff94ea64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:41.934548 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd6538d-0b09-429d-be86-d76bc4f05981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:41.951087 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd6538d-0b09-429d-be86-d76bc4f05981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:56:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1686471809',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=26404d99-9d1f-4064-8284-f793cf278b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7e87a189654e559ead7f80ac37a90e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:56:42Z,use_quota=True,user_id='1e94e88f6c7c425aa1cae382f638ea96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:41.956366 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e42ae5b6-032e-431a-9d29-f6e1e744f29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:41.960423 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e42ae5b6-032e-431a-9d29-f6e1e744f29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:41.966159 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63395afc-a7e6-44d4-b13b-e7de3be98b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:41.970501 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63395afc-a7e6-44d4-b13b-e7de3be98b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26404d99-9d1f-4064-8284-f793cf278b4d', 'volume_name': 'volume-26404d99-9d1f-4064-8284-f793cf278b4d', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:41.975337 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6045e115-fe5a-4f92-958b-ffd5eaaa3675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:41.979259 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6045e115-fe5a-4f92-958b-ffd5eaaa3675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:41.983846 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a88ffe-f606-4fdb-b25d-032a9eba403c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:41.984901 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Volume 26404d99-9d1f-4064-8284-f793cf278b4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26404d99-9d1f-4064-8284-f793cf278b4d', 'volume_size': 1}
Jul 16 21:56:41.985292 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] creating volume 'volume-26404d99-9d1f-4064-8284-f793cf278b4d' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:56:41.985940 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:42.300177 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:56:42.300470 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:56:42.304305 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a88ffe-f606-4fdb-b25d-032a9eba403c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26404d99-9d1f-4064-8284-f793cf278b4d', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:42.309482 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e00bd7-a3df-435d-919e-5ef6bf3be91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:42.376548 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Volume volume-26404d99-9d1f-4064-8284-f793cf278b4d (26404d99-9d1f-4064-8284-f793cf278b4d): created successfully
Jul 16 21:56:42.380069 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e00bd7-a3df-435d-919e-5ef6bf3be91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:42.386265 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Flow 'volume_create_manager' (fe50270b-a999-43ea-91c7-762ff94ea64b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:42.484589 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f8f2a5d5-efd9-4f4a-920c-23f391ec80ab tempest-VolumesGetTest-1454868418 None] Created volume successfully.
Jul 16 21:56:43.020168 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3bca5685-9289-40e2-9053-a1a46baa290f tempest-VolumesGetTest-1454868418 None] Acquiring lock "cinder-26404d99-9d1f-4064-8284-f793cf278b4d-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:56:43.066632 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3bca5685-9289-40e2-9053-a1a46baa290f tempest-VolumesGetTest-1454868418 None] Lock "cinder-26404d99-9d1f-4064-8284-f793cf278b4d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:56:43.066632 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=37,cinder:SELECT=59,cinder:INSERT=3,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:56:43.120994 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3bca5685-9289-40e2-9053-a1a46baa290f tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:43.204768 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3bca5685-9289-40e2-9053-a1a46baa290f tempest-VolumesGetTest-1454868418 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:56:43.205281 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3bca5685-9289-40e2-9053-a1a46baa290f tempest-VolumesGetTest-1454868418 None] Volume volume-26404d99-9d1f-4064-8284-f793cf278b4d is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:56:43.268419 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3bca5685-9289-40e2-9053-a1a46baa290f tempest-VolumesGetTest-1454868418 None] deleting rbd volume volume-26404d99-9d1f-4064-8284-f793cf278b4d {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:56:45.239668 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-3bca5685-9289-40e2-9053-a1a46baa290f tempest-VolumesGetTest-1454868418 None] Created reservations ['c5b5d2ce-d8d4-48b5-850e-1f8c42fb7824', 'af0f2c50-4898-4dde-aa6b-bf21aca05ba2', 'beaaa242-cde2-48e1-9482-a004a23412dc', 'a5cb3331-8240-49f8-acc1-078805b16645'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:56:45.508575 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3bca5685-9289-40e2-9053-a1a46baa290f tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:45.534465 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3bca5685-9289-40e2-9053-a1a46baa290f tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:45.559318 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-3bca5685-9289-40e2-9053-a1a46baa290f tempest-VolumesGetTest-1454868418 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:56:45.563416 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-3bca5685-9289-40e2-9053-a1a46baa290f tempest-VolumesGetTest-1454868418 None] Deleted volume successfully.
Jul 16 21:56:45.637671 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3bca5685-9289-40e2-9053-a1a46baa290f tempest-VolumesGetTest-1454868418 None] Lock "cinder-26404d99-9d1f-4064-8284-f793cf278b4d-delete_volume" released by "delete_volume" :: held 2.607s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:56:46.406108 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-63d472ba-e1f4-4210-8135-8797a8d6a6bb tempest-VolumesGetTest-1454868418 None] Acquiring lock "cinder-45069e67-40e7-4af2-b06b-93a4e57d3a95-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:56:46.415271 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-63d472ba-e1f4-4210-8135-8797a8d6a6bb tempest-VolumesGetTest-1454868418 None] Lock "cinder-45069e67-40e7-4af2-b06b-93a4e57d3a95-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:56:46.482866 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=58,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:56:46.486726 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-63d472ba-e1f4-4210-8135-8797a8d6a6bb tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:46.570354 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-63d472ba-e1f4-4210-8135-8797a8d6a6bb tempest-VolumesGetTest-1454868418 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:56:46.570774 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-63d472ba-e1f4-4210-8135-8797a8d6a6bb tempest-VolumesGetTest-1454868418 None] Volume volume-45069e67-40e7-4af2-b06b-93a4e57d3a95 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:56:46.616850 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-63d472ba-e1f4-4210-8135-8797a8d6a6bb tempest-VolumesGetTest-1454868418 None] deleting rbd volume volume-45069e67-40e7-4af2-b06b-93a4e57d3a95 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:56:48.605345 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-63d472ba-e1f4-4210-8135-8797a8d6a6bb tempest-VolumesGetTest-1454868418 None] Created reservations ['fa254587-3f60-4edb-9ac1-fae8e2714f43', '0f5afb28-ad07-4635-9c01-995a4805c6a2', '2777f7df-71d8-4ba8-b59f-430f11f0b089', 'e6cec4bd-61f2-4105-a9ed-047ccd0ff576'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:56:48.805339 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-63d472ba-e1f4-4210-8135-8797a8d6a6bb tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:48.833284 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-63d472ba-e1f4-4210-8135-8797a8d6a6bb tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:48.858474 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-63d472ba-e1f4-4210-8135-8797a8d6a6bb tempest-VolumesGetTest-1454868418 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:56:48.868689 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-63d472ba-e1f4-4210-8135-8797a8d6a6bb tempest-VolumesGetTest-1454868418 None] Deleted volume successfully.
Jul 16 21:56:48.935260 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-63d472ba-e1f4-4210-8135-8797a8d6a6bb tempest-VolumesGetTest-1454868418 None] Lock "cinder-45069e67-40e7-4af2-b06b-93a4e57d3a95-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:56:50.314541 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:56:50.334310 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Flow 'volume_create_manager' (36192604-0da1-4515-9ff0-6360ebc29e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:50.341738 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b652e523-6e76-4b73-acb5-f97164ebaa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:50.358253 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b652e523-6e76-4b73-acb5-f97164ebaa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-175905953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f7baf9df-23ee-4c66-817b-8c2689ba9fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7e87a189654e559ead7f80ac37a90e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:56:50Z,use_quota=True,user_id='1e94e88f6c7c425aa1cae382f638ea96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:50.363634 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088f0626-fd58-4a91-b9b8-a9a0cbcb8577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:50.367715 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088f0626-fd58-4a91-b9b8-a9a0cbcb8577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:50.373306 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799b8b00-936a-4318-a752-a43a66eef2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:50.377252 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799b8b00-936a-4318-a752-a43a66eef2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7baf9df-23ee-4c66-817b-8c2689ba9fb6', 'volume_name': 'volume-f7baf9df-23ee-4c66-817b-8c2689ba9fb6', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:50.382063 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4ab56e-1a6a-44e3-b1a3-02151cd6c2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:50.385915 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4ab56e-1a6a-44e3-b1a3-02151cd6c2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:50.391182 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cacad8d6-9e13-436e-a274-1f96f6879d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:50.392232 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Volume f7baf9df-23ee-4c66-817b-8c2689ba9fb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7baf9df-23ee-4c66-817b-8c2689ba9fb6', 'volume_size': 1}
Jul 16 21:56:50.392626 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] creating volume 'volume-f7baf9df-23ee-4c66-817b-8c2689ba9fb6' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:56:50.393396 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:50.785342 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:56:50.785634 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:56:50.789330 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cacad8d6-9e13-436e-a274-1f96f6879d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7baf9df-23ee-4c66-817b-8c2689ba9fb6', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:50.794420 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148917b9-925e-4eee-b4d0-753b3e41fcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:50.884830 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Volume volume-f7baf9df-23ee-4c66-817b-8c2689ba9fb6 (f7baf9df-23ee-4c66-817b-8c2689ba9fb6): created successfully
Jul 16 21:56:50.889479 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148917b9-925e-4eee-b4d0-753b3e41fcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:50.894838 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Flow 'volume_create_manager' (36192604-0da1-4515-9ff0-6360ebc29e9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:50.976046 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-90a446de-f929-45fb-80c6-bf10a3d3eb6a tempest-VolumesGetTest-1454868418 None] Created volume successfully.
Jul 16 21:56:51.920647 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:56:51.948128 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Flow 'volume_create_manager' (9e9da7d8-ae2e-4e47-93bd-a48eec6c79f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:51.954486 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (facf1ad0-a1c3-407a-bdfc-3b4e3e9bb79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:51.971406 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (facf1ad0-a1c3-407a-bdfc-3b4e3e9bb79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1343853082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c305693a-61a6-4c65-9894-b44c03a9c8a6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8b7e87a189654e559ead7f80ac37a90e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=f7baf9df-23ee-4c66-817b-8c2689ba9fb6,status='creating',terminated_at=None,updated_at=2022-07-16T21:56:52Z,use_quota=True,user_id='1e94e88f6c7c425aa1cae382f638ea96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:51.976609 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884e692c-6427-4c66-b683-c22b0b26f5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:51.980711 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884e692c-6427-4c66-b683-c22b0b26f5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:51.986654 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db593bd5-11ef-4e0d-b349-b30cc53f34f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:52.003518 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db593bd5-11ef-4e0d-b349-b30cc53f34f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c305693a-61a6-4c65-9894-b44c03a9c8a6', 'volume_name': 'volume-c305693a-61a6-4c65-9894-b44c03a9c8a6', 'volume_size': 1, 'source_volid': 'f7baf9df-23ee-4c66-817b-8c2689ba9fb6', 'source_volstatus': 'available'}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:52.008245 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55910005-8fea-4dab-9307-115515dd6b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:52.012239 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55910005-8fea-4dab-9307-115515dd6b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:52.016792 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02bbfd5c-b595-44f1-8a45-bd2938c7c566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:52.017824 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Volume c305693a-61a6-4c65-9894-b44c03a9c8a6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c305693a-61a6-4c65-9894-b44c03a9c8a6', 'volume_size': 1, 'source_volid': 'f7baf9df-23ee-4c66-817b-8c2689ba9fb6', 'source_volstatus': 'available'}
Jul 16 21:56:52.051409 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:52.158966 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] creating snapshot='volume-c305693a-61a6-4c65-9894-b44c03a9c8a6.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:56:53.233977 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] cloning 'volume-f7baf9df-23ee-4c66-817b-8c2689ba9fb6@volume-c305693a-61a6-4c65-9894-b44c03a9c8a6.clone_snap' to 'volume-c305693a-61a6-4c65-9894-b44c03a9c8a6' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:56:53.812298 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Volume volume-f7baf9df-23ee-4c66-817b-8c2689ba9fb6 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:56:53.813568 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:56:53.813930 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:56:53.957392 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:56:53.961006 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02bbfd5c-b595-44f1-8a45-bd2938c7c566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c305693a-61a6-4c65-9894-b44c03a9c8a6', 'volume_size': 1, 'source_volid': 'f7baf9df-23ee-4c66-817b-8c2689ba9fb6', 'source_volstatus': 'available'}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:53.965420 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b67a93a-1fc8-4f21-9690-4617b95a246c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:54.033215 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Volume volume-c305693a-61a6-4c65-9894-b44c03a9c8a6 (c305693a-61a6-4c65-9894-b44c03a9c8a6): created successfully
Jul 16 21:56:54.036814 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b67a93a-1fc8-4f21-9690-4617b95a246c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:54.042058 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Flow 'volume_create_manager' (9e9da7d8-ae2e-4e47-93bd-a48eec6c79f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:54.113332 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-66c28592-0889-411c-8e91-9b2a40e968bb tempest-VolumesGetTest-1454868418 None] Created volume successfully.
Jul 16 21:56:55.880552 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:56:55.899284 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Flow 'volume_create_manager' (f94f3c8f-2452-4817-a9d8-dcc43b149814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:55.906019 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8531dc60-5184-4454-981b-00d9782f0b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:55.921956 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8531dc60-5184-4454-981b-00d9782f0b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:56:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1221971509',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b02295d6-a1a1-4750-ab76-f6160f864069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7e87a189654e559ead7f80ac37a90e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:56:56Z,use_quota=True,user_id='1e94e88f6c7c425aa1cae382f638ea96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:55.927139 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff403c89-d81e-4d42-a197-0926df4068dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:55.931190 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff403c89-d81e-4d42-a197-0926df4068dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:55.936094 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8131cff-6b56-4e5e-bc2a-c55d79e34bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:55.940043 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8131cff-6b56-4e5e-bc2a-c55d79e34bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b02295d6-a1a1-4750-ab76-f6160f864069', 'volume_name': 'volume-b02295d6-a1a1-4750-ab76-f6160f864069', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:55.944758 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e54d2a-9442-4674-ad55-bd8d636bfd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:55.948553 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e54d2a-9442-4674-ad55-bd8d636bfd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:55.953612 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f97dac-a1b6-4ff3-bbbf-05b63f6fb7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:55.954640 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Volume b02295d6-a1a1-4750-ab76-f6160f864069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b02295d6-a1a1-4750-ab76-f6160f864069', 'volume_size': 1}
Jul 16 21:56:55.955032 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] creating volume 'volume-b02295d6-a1a1-4750-ab76-f6160f864069' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:56:55.955659 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:56.305594 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:56:56.305973 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:56:56.309616 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f97dac-a1b6-4ff3-bbbf-05b63f6fb7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b02295d6-a1a1-4750-ab76-f6160f864069', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:56.314750 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937a6ba4-c2e7-4f81-a375-6920471e2963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:56:56.364741 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Volume volume-b02295d6-a1a1-4750-ab76-f6160f864069 (b02295d6-a1a1-4750-ab76-f6160f864069): created successfully
Jul 16 21:56:56.368327 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937a6ba4-c2e7-4f81-a375-6920471e2963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:56:56.373607 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Flow 'volume_create_manager' (f94f3c8f-2452-4817-a9d8-dcc43b149814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:56:56.416057 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-a1a34b54-aa48-4bd7-b9d9-ba37fd5594b7 tempest-VolumesGetTest-1454868418 None] Created volume successfully.
Jul 16 21:56:56.965590 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a29b3dd6-f656-4728-b5b1-ddb324b0e778 tempest-VolumesGetTest-1454868418 None] Acquiring lock "cinder-b02295d6-a1a1-4750-ab76-f6160f864069-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:56:56.976401 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a29b3dd6-f656-4728-b5b1-ddb324b0e778 tempest-VolumesGetTest-1454868418 None] Lock "cinder-b02295d6-a1a1-4750-ab76-f6160f864069-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:56:57.062398 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a29b3dd6-f656-4728-b5b1-ddb324b0e778 tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:57.181397 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a29b3dd6-f656-4728-b5b1-ddb324b0e778 tempest-VolumesGetTest-1454868418 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:56:57.181822 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a29b3dd6-f656-4728-b5b1-ddb324b0e778 tempest-VolumesGetTest-1454868418 None] Volume volume-b02295d6-a1a1-4750-ab76-f6160f864069 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:56:57.234362 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a29b3dd6-f656-4728-b5b1-ddb324b0e778 tempest-VolumesGetTest-1454868418 None] deleting rbd volume volume-b02295d6-a1a1-4750-ab76-f6160f864069 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:56:59.107551 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-a29b3dd6-f656-4728-b5b1-ddb324b0e778 tempest-VolumesGetTest-1454868418 None] Created reservations ['c2b6bf68-c128-4c2c-8373-7a63ce51e6fe', '048e80d5-878b-4009-8887-1d0d8ad37f57', '45cd5b1d-a86c-4fa8-acb0-ca4a219d1e5b', '8388efb1-a124-4f61-8dd3-3d80a9ccdfb1'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:56:59.285313 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a29b3dd6-f656-4728-b5b1-ddb324b0e778 tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:59.308351 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-a29b3dd6-f656-4728-b5b1-ddb324b0e778 tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:56:59.338809 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-a29b3dd6-f656-4728-b5b1-ddb324b0e778 tempest-VolumesGetTest-1454868418 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:56:59.343487 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-a29b3dd6-f656-4728-b5b1-ddb324b0e778 tempest-VolumesGetTest-1454868418 None] Deleted volume successfully.
Jul 16 21:56:59.402872 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-a29b3dd6-f656-4728-b5b1-ddb324b0e778 tempest-VolumesGetTest-1454868418 None] Lock "cinder-b02295d6-a1a1-4750-ab76-f6160f864069-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:57:00.290281 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-73a27d11-a971-4987-aefa-16ef86ca6777 tempest-VolumesGetTest-1454868418 None] Acquiring lock "cinder-c305693a-61a6-4c65-9894-b44c03a9c8a6-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:57:00.300416 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-73a27d11-a971-4987-aefa-16ef86ca6777 tempest-VolumesGetTest-1454868418 None] Lock "cinder-c305693a-61a6-4c65-9894-b44c03a9c8a6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:57:00.387313 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-73a27d11-a971-4987-aefa-16ef86ca6777 tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:57:00.484651 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-73a27d11-a971-4987-aefa-16ef86ca6777 tempest-VolumesGetTest-1454868418 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:57:00.536855 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-73a27d11-a971-4987-aefa-16ef86ca6777 tempest-VolumesGetTest-1454868418 None] deleting rbd volume volume-c305693a-61a6-4c65-9894-b44c03a9c8a6 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:57:02.542955 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-73a27d11-a971-4987-aefa-16ef86ca6777 tempest-VolumesGetTest-1454868418 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:57:02.644667 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-73a27d11-a971-4987-aefa-16ef86ca6777 tempest-VolumesGetTest-1454868418 None] Volume volume-f7baf9df-23ee-4c66-817b-8c2689ba9fb6 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:57:02.645098 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-73a27d11-a971-4987-aefa-16ef86ca6777 tempest-VolumesGetTest-1454868418 None] deleting parent snapshot volume-c305693a-61a6-4c65-9894-b44c03a9c8a6.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:57:03.621752 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-73a27d11-a971-4987-aefa-16ef86ca6777 tempest-VolumesGetTest-1454868418 None] Created reservations ['9d607807-8880-4492-954f-6c70509fdeff', '96d49d59-2b32-486a-ab1e-a62dbb86277e', '270d04ad-560e-4ad5-a14b-48f84e0fcf94', '9a9731d9-44ab-4b97-9fe5-68965f5f78aa'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:57:03.636562 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=61,cinder:INSERT=9,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:57:03.816343 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-73a27d11-a971-4987-aefa-16ef86ca6777 tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:57:03.841470 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-73a27d11-a971-4987-aefa-16ef86ca6777 tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:57:03.869038 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-73a27d11-a971-4987-aefa-16ef86ca6777 tempest-VolumesGetTest-1454868418 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:57:03.873024 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-73a27d11-a971-4987-aefa-16ef86ca6777 tempest-VolumesGetTest-1454868418 None] Deleted volume successfully.
Jul 16 21:57:03.940411 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-73a27d11-a971-4987-aefa-16ef86ca6777 tempest-VolumesGetTest-1454868418 None] Lock "cinder-c305693a-61a6-4c65-9894-b44c03a9c8a6-delete_volume" released by "delete_volume" :: held 3.640s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:57:05.423251 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:57:05.442830 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Flow 'volume_create_manager' (be140a60-f20b-49a9-97ab-8cddb0847f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:57:05.451440 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77748f60-79c5-47d0-a39b-106f005ef5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:57:05.468574 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77748f60-79c5-47d0-a39b-106f005ef5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1851996723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=72ac2d79-d60a-43a6-8a5f-801145e66c23,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8b7e87a189654e559ead7f80ac37a90e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:57:05Z,use_quota=True,user_id='1e94e88f6c7c425aa1cae382f638ea96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:57:05.473885 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e6349d-8e35-4bd9-a671-04fb1318d3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:57:05.478011 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e6349d-8e35-4bd9-a671-04fb1318d3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:57:05.483185 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b0fa20-8996-42b7-be52-9160f0bdded4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:57:05.564653 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b0fa20-8996-42b7-be52-9160f0bdded4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '72ac2d79-d60a-43a6-8a5f-801145e66c23', 'volume_name': 'volume-72ac2d79-d60a-43a6-8a5f-801145e66c23', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f5e2e80>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:57:05.569922 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4848ba-6920-4b4d-8d55-5d59614e380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:57:05.573572 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4848ba-6920-4b4d-8d55-5d59614e380b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:57:05.579243 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab620f7e-8953-4e0c-9f55-31222043b569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:57:05.580404 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Volume 72ac2d79-d60a-43a6-8a5f-801145e66c23: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-72ac2d79-d60a-43a6-8a5f-801145e66c23', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f5e2e80>}
Jul 16 21:57:05.580982 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Cloning 72ac2d79-d60a-43a6-8a5f-801145e66c23 from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9  at location (None, None). {{(pid=131857) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Jul 16 21:57:05.581723 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Acquiring lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" by "_prepare_image_cache_entry" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:57:05.589137 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:57:05.707573 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 57, 5, 594209)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:57:05.707945 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:57:05.708356 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Found cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Jul 16 21:57:05.723786 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" released by "_prepare_image_cache_entry" :: held 0.124s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:57:05.723786 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Attempting to retrieve cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Jul 16 21:57:05.723786 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 21, 57, 5, 717856)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 21:57:05.723786 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 21:57:05.724136 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Creating from source image-volume b59b3901-b32a-4d92-81b0-6b99e88e4517 {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Jul 16 21:57:05.733831 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:57:05.832871 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] creating snapshot='volume-72ac2d79-d60a-43a6-8a5f-801145e66c23.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 21:57:07.073457 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] cloning 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517@volume-72ac2d79-d60a-43a6-8a5f-801145e66c23.clone_snap' to 'volume-72ac2d79-d60a-43a6-8a5f-801145e66c23' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 21:57:07.078312 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=52,cinder:INSERT=5,cinder:UPDATE=37,cinder:DELETE=6 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:57:07.613543 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945.deleted is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:57:07.614853 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:57:07.615268 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:57:07.872803 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 21:57:07.873449 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Marking volume 72ac2d79-d60a-43a6-8a5f-801145e66c23 as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 21:57:07.970783 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Copying metadata from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 to 72ac2d79-d60a-43a6-8a5f-801145e66c23. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Jul 16 21:57:07.971359 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Creating volume glance metadata for volume 72ac2d79-d60a-43a6-8a5f-801145e66c23 backed by image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131857) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Jul 16 21:57:08.087929 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab620f7e-8953-4e0c-9f55-31222043b569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72ac2d79-d60a-43a6-8a5f-801145e66c23', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958f5e2e80>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:57:08.092680 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c783d460-7d40-47c3-8a20-1946c73c9710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:57:08.170401 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Volume volume-72ac2d79-d60a-43a6-8a5f-801145e66c23 (72ac2d79-d60a-43a6-8a5f-801145e66c23): created successfully
Jul 16 21:57:08.173917 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c783d460-7d40-47c3-8a20-1946c73c9710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:57:08.179386 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Flow 'volume_create_manager' (be140a60-f20b-49a9-97ab-8cddb0847f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:57:08.261838 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-db6e9e5e-6019-41ec-8847-23a06e71c865 tempest-VolumesGetTest-1454868418 None] Created volume successfully.
Jul 16 21:57:09.332494 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 21:57:09.351932 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Flow 'volume_create_manager' (7092ef98-0fad-4e91-baa1-717c7a2accaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:57:09.358214 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d1bda1-2416-47a8-93cb-74bca3e20e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:57:09.374822 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d1bda1-2416-47a8-93cb-74bca3e20e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T21:57:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1728347739',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0cfee90c-c47b-4061-8be5-6a1266bebc45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7e87a189654e559ead7f80ac37a90e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T21:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T21:57:09Z,use_quota=True,user_id='1e94e88f6c7c425aa1cae382f638ea96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:57:09.380590 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d362666-4467-450a-a40c-b86e1e9d1f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:57:09.384619 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d362666-4467-450a-a40c-b86e1e9d1f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:57:09.389547 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c3b210-0999-4ed2-9029-2915bc3aef71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:57:09.393649 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c3b210-0999-4ed2-9029-2915bc3aef71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cfee90c-c47b-4061-8be5-6a1266bebc45', 'volume_name': 'volume-0cfee90c-c47b-4061-8be5-6a1266bebc45', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:57:09.398392 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec38e444-b03c-46ca-99c7-76f4a35ca58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:57:09.402202 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec38e444-b03c-46ca-99c7-76f4a35ca58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:57:09.406791 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e329fa9-ac4d-457a-b964-430d40fee5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:57:09.407856 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Volume 0cfee90c-c47b-4061-8be5-6a1266bebc45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cfee90c-c47b-4061-8be5-6a1266bebc45', 'volume_size': 1}
Jul 16 21:57:09.408242 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] creating volume 'volume-0cfee90c-c47b-4061-8be5-6a1266bebc45' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 21:57:09.409016 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:57:09.779554 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 21:57:09.779927 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 21:57:09.784069 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e329fa9-ac4d-457a-b964-430d40fee5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cfee90c-c47b-4061-8be5-6a1266bebc45', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:57:09.788495 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44dda61c-f163-4b85-9ad2-a31c0549b2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 21:57:09.833226 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Volume volume-0cfee90c-c47b-4061-8be5-6a1266bebc45 (0cfee90c-c47b-4061-8be5-6a1266bebc45): created successfully
Jul 16 21:57:09.836763 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44dda61c-f163-4b85-9ad2-a31c0549b2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 21:57:09.842355 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Flow 'volume_create_manager' (7092ef98-0fad-4e91-baa1-717c7a2accaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 21:57:09.908150 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-af93c314-fcaf-4cab-b85f-c5aa3de3dd8e tempest-VolumesGetTest-1454868418 None] Created volume successfully.
Jul 16 21:57:10.399292 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8ff342e4-7b3a-4bf0-85ce-1766d17f621e tempest-VolumesGetTest-1454868418 None] Acquiring lock "cinder-0cfee90c-c47b-4061-8be5-6a1266bebc45-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:57:10.408923 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8ff342e4-7b3a-4bf0-85ce-1766d17f621e tempest-VolumesGetTest-1454868418 None] Lock "cinder-0cfee90c-c47b-4061-8be5-6a1266bebc45-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:57:10.480375 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8ff342e4-7b3a-4bf0-85ce-1766d17f621e tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:57:10.587176 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8ff342e4-7b3a-4bf0-85ce-1766d17f621e tempest-VolumesGetTest-1454868418 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:57:10.587603 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8ff342e4-7b3a-4bf0-85ce-1766d17f621e tempest-VolumesGetTest-1454868418 None] Volume volume-0cfee90c-c47b-4061-8be5-6a1266bebc45 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:57:10.667703 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8ff342e4-7b3a-4bf0-85ce-1766d17f621e tempest-VolumesGetTest-1454868418 None] deleting rbd volume volume-0cfee90c-c47b-4061-8be5-6a1266bebc45 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:57:12.924531 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-8ff342e4-7b3a-4bf0-85ce-1766d17f621e tempest-VolumesGetTest-1454868418 None] Created reservations ['069c8fa0-b834-4866-90f0-189940676aa4', '5b8985da-7221-4b70-b7c6-c06e96d2ce9b', '8bad30e8-a10d-405f-9528-8919339ee854', '97c4acd2-e5ac-4d04-8edc-8dbfe96f1225'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:57:13.056308 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8ff342e4-7b3a-4bf0-85ce-1766d17f621e tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:57:13.081350 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8ff342e4-7b3a-4bf0-85ce-1766d17f621e tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:57:13.107308 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-8ff342e4-7b3a-4bf0-85ce-1766d17f621e tempest-VolumesGetTest-1454868418 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:57:13.111822 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-8ff342e4-7b3a-4bf0-85ce-1766d17f621e tempest-VolumesGetTest-1454868418 None] Deleted volume successfully.
Jul 16 21:57:13.174368 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-8ff342e4-7b3a-4bf0-85ce-1766d17f621e tempest-VolumesGetTest-1454868418 None] Lock "cinder-0cfee90c-c47b-4061-8be5-6a1266bebc45-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:57:13.739186 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-14181b6a-b66b-4284-9bd7-817aef1e41b0 tempest-VolumesGetTest-1454868418 None] Acquiring lock "cinder-72ac2d79-d60a-43a6-8a5f-801145e66c23-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:57:13.748745 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-14181b6a-b66b-4284-9bd7-817aef1e41b0 tempest-VolumesGetTest-1454868418 None] Lock "cinder-72ac2d79-d60a-43a6-8a5f-801145e66c23-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:57:13.839567 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-14181b6a-b66b-4284-9bd7-817aef1e41b0 tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:57:13.935556 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-14181b6a-b66b-4284-9bd7-817aef1e41b0 tempest-VolumesGetTest-1454868418 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:57:13.977292 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-14181b6a-b66b-4284-9bd7-817aef1e41b0 tempest-VolumesGetTest-1454868418 None] deleting rbd volume volume-72ac2d79-d60a-43a6-8a5f-801145e66c23 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:57:15.730859 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-14181b6a-b66b-4284-9bd7-817aef1e41b0 tempest-VolumesGetTest-1454868418 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 21:57:15.816187 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-14181b6a-b66b-4284-9bd7-817aef1e41b0 tempest-VolumesGetTest-1454868418 None] deleting parent snapshot volume-72ac2d79-d60a-43a6-8a5f-801145e66c23.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 21:57:17.244713 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-14181b6a-b66b-4284-9bd7-817aef1e41b0 tempest-VolumesGetTest-1454868418 None] Created reservations ['aacb5f73-2804-4797-9c25-82139c11d2a6', '62c369fb-f5e5-4f67-820f-bd41d56f2fb6', 'b05f78a1-a666-46b7-95a2-0967dd9a4e62', '7851c4c1-eedd-4f30-9959-7c3ce86b22ef'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:57:17.404800 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-14181b6a-b66b-4284-9bd7-817aef1e41b0 tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:57:17.428029 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-14181b6a-b66b-4284-9bd7-817aef1e41b0 tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:57:17.452456 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-14181b6a-b66b-4284-9bd7-817aef1e41b0 tempest-VolumesGetTest-1454868418 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:57:17.457177 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-14181b6a-b66b-4284-9bd7-817aef1e41b0 tempest-VolumesGetTest-1454868418 None] Deleted volume successfully.
Jul 16 21:57:17.528029 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-14181b6a-b66b-4284-9bd7-817aef1e41b0 tempest-VolumesGetTest-1454868418 None] Lock "cinder-72ac2d79-d60a-43a6-8a5f-801145e66c23-delete_volume" released by "delete_volume" :: held 3.779s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:57:18.244970 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e0df44da-efc2-426d-90d6-25067ca24c11 tempest-VolumesGetTest-1454868418 None] Acquiring lock "cinder-f7baf9df-23ee-4c66-817b-8c2689ba9fb6-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 21:57:18.257916 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e0df44da-efc2-426d-90d6-25067ca24c11 tempest-VolumesGetTest-1454868418 None] Lock "cinder-f7baf9df-23ee-4c66-817b-8c2689ba9fb6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 21:57:18.331583 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e0df44da-efc2-426d-90d6-25067ca24c11 tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:57:18.404044 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e0df44da-efc2-426d-90d6-25067ca24c11 tempest-VolumesGetTest-1454868418 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 21:57:18.404487 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e0df44da-efc2-426d-90d6-25067ca24c11 tempest-VolumesGetTest-1454868418 None] Volume volume-f7baf9df-23ee-4c66-817b-8c2689ba9fb6 is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 21:57:18.530346 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e0df44da-efc2-426d-90d6-25067ca24c11 tempest-VolumesGetTest-1454868418 None] deleting rbd volume volume-f7baf9df-23ee-4c66-817b-8c2689ba9fb6 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 21:57:20.628446 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-e0df44da-efc2-426d-90d6-25067ca24c11 tempest-VolumesGetTest-1454868418 None] Created reservations ['5f670bb3-6783-4fdf-9b6f-4aa1e3f6bdc7', 'd6c55965-de3b-48cc-9783-a3f7589d3eba', 'e27bba74-e221-4e77-90b2-158ef65f52ec', '74b8a903-9b1f-4983-956b-20cb6e868a8e'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 21:57:20.805135 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e0df44da-efc2-426d-90d6-25067ca24c11 tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:57:20.829820 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-e0df44da-efc2-426d-90d6-25067ca24c11 tempest-VolumesGetTest-1454868418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:57:20.858013 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-e0df44da-efc2-426d-90d6-25067ca24c11 tempest-VolumesGetTest-1454868418 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:57:20.862236 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-e0df44da-efc2-426d-90d6-25067ca24c11 tempest-VolumesGetTest-1454868418 None] Deleted volume successfully.
Jul 16 21:57:20.922370 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-e0df44da-efc2-426d-90d6-25067ca24c11 tempest-VolumesGetTest-1454868418 None] Lock "cinder-f7baf9df-23ee-4c66-817b-8c2689ba9fb6-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 21:57:27.155326 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=54,cinder:UPDATE=33,cinder:INSERT=11,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:57:27.161544 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=59,cinder:INSERT=13,cinder:UPDATE=25,cinder:DELETE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:57:38.420535 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:57:38.422677 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:57:38.471719 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:57:38.508560 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:58:07.146260 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:58:07.146891 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:58:37.157865 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:58:38.424633 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:58:38.426194 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:58:38.464321 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:58:38.497512 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:58:47.163985 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:59:07.161699 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:59:17.169337 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:59:38.422889 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 21:59:38.423639 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:59:38.448056 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 21:59:38.472429 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 21:59:47.169309 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 21:59:57.175984 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:00:17.172552 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:00:37.170359 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:00:38.427604 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:00:38.428267 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:00:38.451316 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:00:38.477472 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:00:57.172507 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:01:17.163622 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:01:37.167460 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:01:38.432259 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:01:38.433085 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:01:38.458979 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:01:38.485370 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:01:57.164079 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:02:17.166378 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:02:37.170117 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:02:38.430552 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:02:38.431258 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:02:38.455479 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:02:38.479465 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:02:47.179552 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:02:57.181416 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:03:17.189086 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:03:38.434383 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:03:38.435083 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:03:38.464589 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:03:38.495293 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:03:47.189756 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:03:47.190631 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:04:17.196649 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:04:27.199987 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:04:38.430567 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:04:38.431313 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:04:38.455429 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:04:38.479787 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:04:47.199471 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:05:07.199284 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:05:17.208122 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:05:38.435454 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:05:38.436195 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:05:38.463527 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:05:38.522760 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:05:47.204610 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:05:57.210113 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:06:14.981459 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 22:06:14.999703 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Flow 'volume_create_manager' (563f9985-52da-444d-b87f-61cdf070e002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 22:06:15.006291 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04945386-df66-423f-bacd-7d9b2a6db366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:06:15.022088 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04945386-df66-423f-bacd-7d9b2a6db366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T22:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-343853134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=676c3d70-8f91-42ab-ab5c-273031e5f37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd21231d9af34d9aa4f9e03229b49a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T22:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T22:06:15Z,use_quota=True,user_id='718f6de3b1a1453d9579d421a574691e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:06:15.027272 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc49c1d9-d855-4f0d-9dfa-c5ada173ac12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:06:15.031266 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc49c1d9-d855-4f0d-9dfa-c5ada173ac12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:06:15.036813 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59afcbf3-6c6d-4c99-9cdc-0b7b04a20977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:06:15.040731 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59afcbf3-6c6d-4c99-9cdc-0b7b04a20977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '676c3d70-8f91-42ab-ab5c-273031e5f37b', 'volume_name': 'volume-676c3d70-8f91-42ab-ab5c-273031e5f37b', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:06:15.045447 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d68a57-5645-443e-8554-f81fcd187fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:06:15.049231 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d68a57-5645-443e-8554-f81fcd187fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:06:15.053958 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad649112-1d67-4eb1-8d4a-7b674a1f4c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:06:15.054990 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Volume 676c3d70-8f91-42ab-ab5c-273031e5f37b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-676c3d70-8f91-42ab-ab5c-273031e5f37b', 'volume_size': 1}
Jul 16 22:06:15.055463 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] creating volume 'volume-676c3d70-8f91-42ab-ab5c-273031e5f37b' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 22:06:15.056199 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:06:15.548740 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 22:06:15.549067 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 22:06:15.552791 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad649112-1d67-4eb1-8d4a-7b674a1f4c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-676c3d70-8f91-42ab-ab5c-273031e5f37b', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:06:15.557315 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad32c5f-5964-4271-b12f-8c33204f08ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:06:15.624912 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Volume volume-676c3d70-8f91-42ab-ab5c-273031e5f37b (676c3d70-8f91-42ab-ab5c-273031e5f37b): created successfully
Jul 16 22:06:15.628345 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad32c5f-5964-4271-b12f-8c33204f08ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:06:15.633803 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Flow 'volume_create_manager' (563f9985-52da-444d-b87f-61cdf070e002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 22:06:15.716368 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-8c3f54d3-0f0b-42f2-9317-da067ed5da8c tempest-ServerActionsTestJSON-164809533 None] Created volume successfully.
Jul 16 22:06:17.556565 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:06:17.566248 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-d391ba20-9f01-4608-aa24-5e31e4bd728c req-4a8f45cc-4db7-4f0b-86f8-1f3722529a85 tempest-ServerActionsTestJSON-164809533 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 22:06:18.336314 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-d391ba20-9f01-4608-aa24-5e31e4bd728c req-4a8f45cc-4db7-4f0b-86f8-1f3722529a85 tempest-ServerActionsTestJSON-164809533 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.770s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 22:06:18.337119 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-d391ba20-9f01-4608-aa24-5e31e4bd728c req-4a8f45cc-4db7-4f0b-86f8-1f3722529a85 tempest-ServerActionsTestJSON-164809533 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-676c3d70-8f91-42ab-ab5c-273031e5f37b', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '676c3d70-8f91-42ab-ab5c-273031e5f37b', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 22:06:18.425791 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-d391ba20-9f01-4608-aa24-5e31e4bd728c req-4a8f45cc-4db7-4f0b-86f8-1f3722529a85 tempest-ServerActionsTestJSON-164809533 None] Connection info returned from driver {'name': 'volumes/volume-676c3d70-8f91-42ab-ab5c-273031e5f37b', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '676c3d70-8f91-42ab-ab5c-273031e5f37b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b7271278-b15a-42b5-9f2f-c13b9b9c0ca6'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 22:06:18.565703 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-d391ba20-9f01-4608-aa24-5e31e4bd728c req-4a8f45cc-4db7-4f0b-86f8-1f3722529a85 tempest-ServerActionsTestJSON-164809533 None] attachment_update completed successfully.
Jul 16 22:06:37.215602 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:06:37.218046 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:06:37.695340 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-4fdd1ec6-cda4-45bc-9d40-bceef53db968 req-5b212657-c2ec-46c9-9f2c-9a107ca9dee4 tempest-ServerActionsTestJSON-164809533 None] Terminate volume connection completed successfully.
Jul 16 22:06:37.695788 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-4fdd1ec6-cda4-45bc-9d40-bceef53db968 req-5b212657-c2ec-46c9-9f2c-9a107ca9dee4 tempest-ServerActionsTestJSON-164809533 None] Deleting attachment b7271278-b15a-42b5-9f2f-c13b9b9c0ca6. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 22:06:38.438159 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:06:38.439098 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:06:38.485137 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:06:38.527031 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:06:40.938841 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-4fdd1ec6-cda4-45bc-9d40-bceef53db968 req-71486cc2-95b5-4572-9746-6c9ba5efb3d9 tempest-ServerActionsTestJSON-164809533 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 22:06:41.758537 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-4fdd1ec6-cda4-45bc-9d40-bceef53db968 req-71486cc2-95b5-4572-9746-6c9ba5efb3d9 tempest-ServerActionsTestJSON-164809533 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.819s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 22:06:41.759422 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-4fdd1ec6-cda4-45bc-9d40-bceef53db968 req-71486cc2-95b5-4572-9746-6c9ba5efb3d9 tempest-ServerActionsTestJSON-164809533 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-676c3d70-8f91-42ab-ab5c-273031e5f37b', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '676c3d70-8f91-42ab-ab5c-273031e5f37b', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 22:06:41.840161 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-4fdd1ec6-cda4-45bc-9d40-bceef53db968 req-71486cc2-95b5-4572-9746-6c9ba5efb3d9 tempest-ServerActionsTestJSON-164809533 None] Connection info returned from driver {'name': 'volumes/volume-676c3d70-8f91-42ab-ab5c-273031e5f37b', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '676c3d70-8f91-42ab-ab5c-273031e5f37b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b83ef69a-8e27-4214-b133-c5faccf04e9d'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 22:06:41.957382 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-4fdd1ec6-cda4-45bc-9d40-bceef53db968 req-71486cc2-95b5-4572-9746-6c9ba5efb3d9 tempest-ServerActionsTestJSON-164809533 None] attachment_update completed successfully.
Jul 16 22:06:50.831621 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-f7a0ed9b-2b50-4ced-9b4a-0d42f265d692 req-d738918b-ce02-46ed-877e-2b8b147e09f2 tempest-ServerActionsTestJSON-164809533 None] Terminate volume connection completed successfully.
Jul 16 22:06:50.832280 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-f7a0ed9b-2b50-4ced-9b4a-0d42f265d692 req-d738918b-ce02-46ed-877e-2b8b147e09f2 tempest-ServerActionsTestJSON-164809533 None] Deleting attachment b83ef69a-8e27-4214-b133-c5faccf04e9d. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 22:06:54.089235 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-f7a0ed9b-2b50-4ced-9b4a-0d42f265d692 req-fe6e9564-f7d4-4e23-a4a9-3f325b88948f tempest-ServerActionsTestJSON-164809533 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 22:06:54.848580 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-f7a0ed9b-2b50-4ced-9b4a-0d42f265d692 req-fe6e9564-f7d4-4e23-a4a9-3f325b88948f tempest-ServerActionsTestJSON-164809533 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.759s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 22:06:54.849389 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-f7a0ed9b-2b50-4ced-9b4a-0d42f265d692 req-fe6e9564-f7d4-4e23-a4a9-3f325b88948f tempest-ServerActionsTestJSON-164809533 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-676c3d70-8f91-42ab-ab5c-273031e5f37b', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '676c3d70-8f91-42ab-ab5c-273031e5f37b', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 22:06:54.962107 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-f7a0ed9b-2b50-4ced-9b4a-0d42f265d692 req-fe6e9564-f7d4-4e23-a4a9-3f325b88948f tempest-ServerActionsTestJSON-164809533 None] Connection info returned from driver {'name': 'volumes/volume-676c3d70-8f91-42ab-ab5c-273031e5f37b', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '676c3d70-8f91-42ab-ab5c-273031e5f37b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '946189e5-0863-4fb7-8f92-659ec70ac5a7'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 22:06:55.084965 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-f7a0ed9b-2b50-4ced-9b4a-0d42f265d692 req-fe6e9564-f7d4-4e23-a4a9-3f325b88948f tempest-ServerActionsTestJSON-164809533 None] attachment_update completed successfully.
Jul 16 22:07:02.100733 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-828b5fda-5944-4ed4-8589-a30f9576f19c req-dfa27a2b-0034-45c7-a48f-8fc245e3f628 tempest-ServerActionsTestJSON-164809533 None] Terminate volume connection completed successfully.
Jul 16 22:07:02.101415 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-828b5fda-5944-4ed4-8589-a30f9576f19c req-dfa27a2b-0034-45c7-a48f-8fc245e3f628 tempest-ServerActionsTestJSON-164809533 None] Deleting attachment 946189e5-0863-4fb7-8f92-659ec70ac5a7. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 22:07:03.185513 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-bf3511e2-7839-4d19-b16f-f05294719a8a tempest-ServerActionsTestJSON-164809533 None] Acquiring lock "cinder-676c3d70-8f91-42ab-ab5c-273031e5f37b-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 22:07:03.200185 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-bf3511e2-7839-4d19-b16f-f05294719a8a tempest-ServerActionsTestJSON-164809533 None] Lock "cinder-676c3d70-8f91-42ab-ab5c-273031e5f37b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 22:07:03.291665 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bf3511e2-7839-4d19-b16f-f05294719a8a tempest-ServerActionsTestJSON-164809533 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:07:03.393602 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bf3511e2-7839-4d19-b16f-f05294719a8a tempest-ServerActionsTestJSON-164809533 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 22:07:03.394042 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bf3511e2-7839-4d19-b16f-f05294719a8a tempest-ServerActionsTestJSON-164809533 None] Volume volume-676c3d70-8f91-42ab-ab5c-273031e5f37b is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 22:07:03.468624 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bf3511e2-7839-4d19-b16f-f05294719a8a tempest-ServerActionsTestJSON-164809533 None] deleting rbd volume volume-676c3d70-8f91-42ab-ab5c-273031e5f37b {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 22:07:05.593431 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-bf3511e2-7839-4d19-b16f-f05294719a8a tempest-ServerActionsTestJSON-164809533 None] Created reservations ['2d04be30-56c8-495e-9234-fcf66be46698', '8f9c6a26-bed9-4d99-b2bb-fc93ced05b62', '81406f16-8bef-4262-b64e-6be1cc176ca3', '21ba4078-4430-4b8b-88cf-d6f02352cde1'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 22:07:05.784591 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bf3511e2-7839-4d19-b16f-f05294719a8a tempest-ServerActionsTestJSON-164809533 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:07:05.822764 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-bf3511e2-7839-4d19-b16f-f05294719a8a tempest-ServerActionsTestJSON-164809533 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:07:05.849150 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-bf3511e2-7839-4d19-b16f-f05294719a8a tempest-ServerActionsTestJSON-164809533 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:07:05.854400 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-bf3511e2-7839-4d19-b16f-f05294719a8a tempest-ServerActionsTestJSON-164809533 None] Deleted volume successfully.
Jul 16 22:07:05.918167 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-bf3511e2-7839-4d19-b16f-f05294719a8a tempest-ServerActionsTestJSON-164809533 None] Lock "cinder-676c3d70-8f91-42ab-ab5c-273031e5f37b-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 22:07:17.229219 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=40,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:07:17.230215 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=50,cinder:UPDATE=16,cinder:INSERT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:07:27.821085 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:07:37.224195 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:07:38.442084 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:07:38.442758 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:07:38.468326 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:07:38.491629 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:08:07.217331 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:08:17.218181 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:08:38.438325 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:08:38.439298 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:08:38.496236 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:08:38.554901 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:08:47.221411 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:08:57.239801 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:09:08.548322 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 22:09:08.568521 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Flow 'volume_create_manager' (c5e54f9e-d697-4b61-9cee-7a52203569f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 22:09:08.575109 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dda6633-91c3-43e3-ad1c-a6e06db17245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:09:08.592510 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dda6633-91c3-43e3-ad1c-a6e06db17245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T22:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1037643796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3a5baf74-a675-4ae1-962b-69743c9186ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb1e913bedd4fb5b286e21c60e27a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T22:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T22:09:08Z,use_quota=True,user_id='d749cd77cf5c489e8c4e57e02ce768fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:09:08.598280 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79e8e7e-14ba-4fd9-b7b2-3c14b856a0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:09:08.602264 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79e8e7e-14ba-4fd9-b7b2-3c14b856a0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:09:08.607228 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26b2819-3ff6-4043-a1b6-f9620ef6c1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:09:08.611159 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26b2819-3ff6-4043-a1b6-f9620ef6c1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a5baf74-a675-4ae1-962b-69743c9186ec', 'volume_name': 'volume-3a5baf74-a675-4ae1-962b-69743c9186ec', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:09:08.616938 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1587e430-1370-4024-b998-5da76f9f7cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:09:08.620713 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1587e430-1370-4024-b998-5da76f9f7cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:09:08.625240 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d5ffff-5318-4071-b51e-fac2815e8d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:09:08.626286 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Volume 3a5baf74-a675-4ae1-962b-69743c9186ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a5baf74-a675-4ae1-962b-69743c9186ec', 'volume_size': 1}
Jul 16 22:09:08.626678 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] creating volume 'volume-3a5baf74-a675-4ae1-962b-69743c9186ec' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 22:09:08.627461 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:09:09.000515 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 22:09:09.000897 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 22:09:09.004701 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d5ffff-5318-4071-b51e-fac2815e8d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5baf74-a675-4ae1-962b-69743c9186ec', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:09:09.009145 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b1a341-9dc5-4e06-8b7f-04d0e0dfbee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:09:09.093848 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Volume volume-3a5baf74-a675-4ae1-962b-69743c9186ec (3a5baf74-a675-4ae1-962b-69743c9186ec): created successfully
Jul 16 22:09:09.098074 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b1a341-9dc5-4e06-8b7f-04d0e0dfbee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:09:09.103369 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Flow 'volume_create_manager' (c5e54f9e-d697-4b61-9cee-7a52203569f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 22:09:09.173834 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-669874b8-42e9-43c5-baa8-5948259b2b01 tempest-TestMinimumBasicScenario-1144486311 None] Created volume successfully.
Jul 16 22:09:10.461038 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-733fd47a-49d9-49ee-9289-febfd300f9db req-4bf0e7e4-dd90-4212-841c-0c0010c06e1f tempest-TestMinimumBasicScenario-1144486311 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 22:09:11.296047 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-733fd47a-49d9-49ee-9289-febfd300f9db req-4bf0e7e4-dd90-4212-841c-0c0010c06e1f tempest-TestMinimumBasicScenario-1144486311 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.834s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 22:09:11.296822 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-733fd47a-49d9-49ee-9289-febfd300f9db req-4bf0e7e4-dd90-4212-841c-0c0010c06e1f tempest-TestMinimumBasicScenario-1144486311 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3a5baf74-a675-4ae1-962b-69743c9186ec', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '3a5baf74-a675-4ae1-962b-69743c9186ec', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 22:09:11.375261 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-733fd47a-49d9-49ee-9289-febfd300f9db req-4bf0e7e4-dd90-4212-841c-0c0010c06e1f tempest-TestMinimumBasicScenario-1144486311 None] Connection info returned from driver {'name': 'volumes/volume-3a5baf74-a675-4ae1-962b-69743c9186ec', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3a5baf74-a675-4ae1-962b-69743c9186ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ad0eede1-5ac8-4cbd-9cd4-702c110f4a21'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 22:09:11.498489 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-733fd47a-49d9-49ee-9289-febfd300f9db req-4bf0e7e4-dd90-4212-841c-0c0010c06e1f tempest-TestMinimumBasicScenario-1144486311 None] attachment_update completed successfully.
Jul 16 22:09:14.100067 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-b3aea3c7-17de-47a3-9b67-30d8c346440f tempest-TestMinimumBasicScenario-1144486311 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:09:15.706520 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-b3aea3c7-17de-47a3-9b67-30d8c346440f tempest-TestMinimumBasicScenario-1144486311 None] Create snapshot completed successfully
Jul 16 22:09:27.220364 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:09:37.219501 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=29,cinder:UPDATE=6 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:09:38.443776 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:09:38.444522 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:09:38.468760 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:09:38.492708 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:09:57.217124 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:10:07.223657 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:10:37.227369 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:10:38.447760 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:10:38.448408 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:10:38.472716 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:10:38.496424 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:10:47.237712 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:11:01.507130 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-c846fb88-d6ad-4fa0-b58f-ee3a7ef7c3f8 tempest-TestMinimumBasicScenario-1144486311 None] Acquiring lock "cinder-31bf0352-fa23-4b95-a570-1aa2c7750b6b-delete_snapshot" by "delete_snapshot" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 22:11:01.522473 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-c846fb88-d6ad-4fa0-b58f-ee3a7ef7c3f8 tempest-TestMinimumBasicScenario-1144486311 None] Lock "cinder-31bf0352-fa23-4b95-a570-1aa2c7750b6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 22:11:01.524334 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-c846fb88-d6ad-4fa0-b58f-ee3a7ef7c3f8 tempest-TestMinimumBasicScenario-1144486311 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:11:07.231791 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:11:17.233871 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:11:32.120443 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-c846fb88-d6ad-4fa0-b58f-ee3a7ef7c3f8 tempest-TestMinimumBasicScenario-1144486311 None] Created reservations ['71979aea-aa50-4855-a1e6-9be928811721', 'da13451b-8229-4c58-b070-efecf273613a', '0aaa46e6-9f4f-4e2b-b5d0-fd1e4c19c07c', 'd23d7e39-f316-45ee-92e7-b7b1169c5133'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 22:11:32.308664 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-c846fb88-d6ad-4fa0-b58f-ee3a7ef7c3f8 tempest-TestMinimumBasicScenario-1144486311 None] Delete snapshot completed successfully.
Jul 16 22:11:32.313742 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-c846fb88-d6ad-4fa0-b58f-ee3a7ef7c3f8 tempest-TestMinimumBasicScenario-1144486311 None] Lock "cinder-31bf0352-fa23-4b95-a570-1aa2c7750b6b-delete_snapshot" released by "delete_snapshot" :: held 30.791s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 22:11:38.451676 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:11:38.452618 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:11:38.476761 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:11:38.500736 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:11:47.236779 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=13,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:11:47.237443 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:12:07.243649 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:12:27.243627 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:12:38.456264 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:12:38.456999 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:12:38.480121 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:12:38.502870 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:12:47.237604 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:12:50.623153 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-4000fe36-9fea-45d7-8b2a-6b1d8ef739c1 req-9f67e1cf-d3f0-43e9-bc33-6ceb9cdb0f4b tempest-TestMinimumBasicScenario-1144486311 None] Terminate volume connection completed successfully.
Jul 16 22:12:50.623801 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-4000fe36-9fea-45d7-8b2a-6b1d8ef739c1 req-9f67e1cf-d3f0-43e9-bc33-6ceb9cdb0f4b tempest-TestMinimumBasicScenario-1144486311 None] Deleting attachment ad0eede1-5ac8-4cbd-9cd4-702c110f4a21. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 22:12:51.274017 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-d39d8be9-299e-4320-a98b-83590f539210 tempest-TestMinimumBasicScenario-1144486311 None] Acquiring lock "cinder-3a5baf74-a675-4ae1-962b-69743c9186ec-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 22:12:51.283762 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-d39d8be9-299e-4320-a98b-83590f539210 tempest-TestMinimumBasicScenario-1144486311 None] Lock "cinder-3a5baf74-a675-4ae1-962b-69743c9186ec-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 22:12:51.375393 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d39d8be9-299e-4320-a98b-83590f539210 tempest-TestMinimumBasicScenario-1144486311 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:12:51.483579 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d39d8be9-299e-4320-a98b-83590f539210 tempest-TestMinimumBasicScenario-1144486311 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 22:12:51.484026 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d39d8be9-299e-4320-a98b-83590f539210 tempest-TestMinimumBasicScenario-1144486311 None] Volume volume-3a5baf74-a675-4ae1-962b-69743c9186ec is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 22:12:51.541263 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d39d8be9-299e-4320-a98b-83590f539210 tempest-TestMinimumBasicScenario-1144486311 None] deleting rbd volume volume-3a5baf74-a675-4ae1-962b-69743c9186ec {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 22:12:53.667080 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-d39d8be9-299e-4320-a98b-83590f539210 tempest-TestMinimumBasicScenario-1144486311 None] Created reservations ['6757e4c3-8de9-4521-9dfd-93ce63a4c715', 'dec0a4c1-5f25-4aa6-a927-d02425bbc2f0', 'd2c0c77d-3587-4c16-9708-b56b43e6e849', 'fcf0dd58-df11-40a6-bd64-126057efaee7'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 22:12:53.809867 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d39d8be9-299e-4320-a98b-83590f539210 tempest-TestMinimumBasicScenario-1144486311 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:12:53.838419 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-d39d8be9-299e-4320-a98b-83590f539210 tempest-TestMinimumBasicScenario-1144486311 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:12:53.913469 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-d39d8be9-299e-4320-a98b-83590f539210 tempest-TestMinimumBasicScenario-1144486311 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:12:53.919093 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-d39d8be9-299e-4320-a98b-83590f539210 tempest-TestMinimumBasicScenario-1144486311 None] Deleted volume successfully.
Jul 16 22:12:54.008295 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-d39d8be9-299e-4320-a98b-83590f539210 tempest-TestMinimumBasicScenario-1144486311 None] Lock "cinder-3a5baf74-a675-4ae1-962b-69743c9186ec-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 22:13:07.245293 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=20,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:13:27.244368 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=20,cinder:INSERT=2,cinder:UPDATE=11 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:13:30.233447 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 22:13:30.252928 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Flow 'volume_create_manager' (d0db16dc-3f26-4c5a-ab86-ce708cc84754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 22:13:30.259318 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126c760b-6398-4855-96b7-71cebce67af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:13:30.276090 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126c760b-6398-4855-96b7-71cebce67af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T22:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1720787245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=36056bf8-8e40-4e6d-8dbd-37c6058c9b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb1e913bedd4fb5b286e21c60e27a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T22:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T22:13:30Z,use_quota=True,user_id='d749cd77cf5c489e8c4e57e02ce768fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:13:30.281368 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d924b9e6-18df-404c-a132-c3d68fa660ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:13:30.285457 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d924b9e6-18df-404c-a132-c3d68fa660ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:13:30.290465 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98bc213-79cf-4e8e-8542-7930860e8d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:13:30.295219 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98bc213-79cf-4e8e-8542-7930860e8d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36056bf8-8e40-4e6d-8dbd-37c6058c9b1f', 'volume_name': 'volume-36056bf8-8e40-4e6d-8dbd-37c6058c9b1f', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:13:30.300008 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e01576-7135-48fc-9e6c-22fdb0748349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:13:30.303872 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e01576-7135-48fc-9e6c-22fdb0748349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:13:30.309033 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99da1719-831b-4f2c-8567-a9daf4a74e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:13:30.310123 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Volume 36056bf8-8e40-4e6d-8dbd-37c6058c9b1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36056bf8-8e40-4e6d-8dbd-37c6058c9b1f', 'volume_size': 1}
Jul 16 22:13:30.310528 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] creating volume 'volume-36056bf8-8e40-4e6d-8dbd-37c6058c9b1f' {{(pid=131857) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Jul 16 22:13:30.311323 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:13:30.646249 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 22:13:30.646623 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 22:13:30.650254 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99da1719-831b-4f2c-8567-a9daf4a74e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36056bf8-8e40-4e6d-8dbd-37c6058c9b1f', 'volume_size': 1}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:13:30.655659 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56899996-3ae7-4283-b107-0b3898ce3124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:13:30.728272 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Volume volume-36056bf8-8e40-4e6d-8dbd-37c6058c9b1f (36056bf8-8e40-4e6d-8dbd-37c6058c9b1f): created successfully
Jul 16 22:13:30.732076 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56899996-3ae7-4283-b107-0b3898ce3124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:13:30.737524 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Flow 'volume_create_manager' (d0db16dc-3f26-4c5a-ab86-ce708cc84754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 22:13:30.802734 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-f5be9415-f3d8-442b-a4f5-da81927f0e7b tempest-TestMinimumBasicScenario-1144486311 None] Created volume successfully.
Jul 16 22:13:31.996805 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-d0e5e3b7-9fc7-4e85-b96f-7b59014f8bf6 req-725c90cd-cdd6-4469-9194-32431c0ab713 tempest-TestMinimumBasicScenario-1144486311 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 22:13:32.769590 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-d0e5e3b7-9fc7-4e85-b96f-7b59014f8bf6 req-725c90cd-cdd6-4469-9194-32431c0ab713 tempest-TestMinimumBasicScenario-1144486311 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.772s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 22:13:32.770432 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-d0e5e3b7-9fc7-4e85-b96f-7b59014f8bf6 req-725c90cd-cdd6-4469-9194-32431c0ab713 tempest-TestMinimumBasicScenario-1144486311 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-36056bf8-8e40-4e6d-8dbd-37c6058c9b1f', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '36056bf8-8e40-4e6d-8dbd-37c6058c9b1f', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 22:13:32.877921 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-d0e5e3b7-9fc7-4e85-b96f-7b59014f8bf6 req-725c90cd-cdd6-4469-9194-32431c0ab713 tempest-TestMinimumBasicScenario-1144486311 None] Connection info returned from driver {'name': 'volumes/volume-36056bf8-8e40-4e6d-8dbd-37c6058c9b1f', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '36056bf8-8e40-4e6d-8dbd-37c6058c9b1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '269a2b52-1d2a-4a59-a474-dc0e8aa2d247'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 22:13:33.010756 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-d0e5e3b7-9fc7-4e85-b96f-7b59014f8bf6 req-725c90cd-cdd6-4469-9194-32431c0ab713 tempest-TestMinimumBasicScenario-1144486311 None] attachment_update completed successfully.
Jul 16 22:13:38.457623 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:13:38.458582 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:13:38.486835 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:13:38.516649 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:13:43.009300 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=22,cinder:UPDATE=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:13:57.251823 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:14:07.241396 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:14:17.249821 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:14:38.461742 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:14:38.462448 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:14:38.485929 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:14:38.508807 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:14:47.252263 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:14:50.337052 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:14:50.344977 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-a75343a8-5186-4bac-8f63-96b84050973b req-c9118bbf-7147-4243-816e-2e3a24aaf29e tempest-TestMinimumBasicScenario-1144486311 None] Terminate volume connection completed successfully.
Jul 16 22:14:50.345681 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-a75343a8-5186-4bac-8f63-96b84050973b req-c9118bbf-7147-4243-816e-2e3a24aaf29e tempest-TestMinimumBasicScenario-1144486311 None] Deleting attachment 269a2b52-1d2a-4a59-a474-dc0e8aa2d247. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 22:14:51.024644 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3b4eafd4-c28d-4b1b-ab1a-389eb2031a3b tempest-TestMinimumBasicScenario-1144486311 None] Acquiring lock "cinder-36056bf8-8e40-4e6d-8dbd-37c6058c9b1f-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 22:14:51.035928 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3b4eafd4-c28d-4b1b-ab1a-389eb2031a3b tempest-TestMinimumBasicScenario-1144486311 None] Lock "cinder-36056bf8-8e40-4e6d-8dbd-37c6058c9b1f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 22:14:51.128079 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3b4eafd4-c28d-4b1b-ab1a-389eb2031a3b tempest-TestMinimumBasicScenario-1144486311 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:14:51.246956 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3b4eafd4-c28d-4b1b-ab1a-389eb2031a3b tempest-TestMinimumBasicScenario-1144486311 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 22:14:51.247451 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3b4eafd4-c28d-4b1b-ab1a-389eb2031a3b tempest-TestMinimumBasicScenario-1144486311 None] Volume volume-36056bf8-8e40-4e6d-8dbd-37c6058c9b1f is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 22:14:51.293384 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3b4eafd4-c28d-4b1b-ab1a-389eb2031a3b tempest-TestMinimumBasicScenario-1144486311 None] deleting rbd volume volume-36056bf8-8e40-4e6d-8dbd-37c6058c9b1f {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 22:14:53.664886 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [None req-3b4eafd4-c28d-4b1b-ab1a-389eb2031a3b tempest-TestMinimumBasicScenario-1144486311 None] Created reservations ['e99b86e8-600a-4401-b1c9-e30b12c39725', '1d4a28cd-bda4-4099-b79b-f2aa2c3626e6', 'bcd62b2c-7124-43cf-8750-8370537daf06', '853c1f26-a99c-42d6-b8d9-67f7ed502299'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 22:14:53.835235 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3b4eafd4-c28d-4b1b-ab1a-389eb2031a3b tempest-TestMinimumBasicScenario-1144486311 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:14:53.859773 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-3b4eafd4-c28d-4b1b-ab1a-389eb2031a3b tempest-TestMinimumBasicScenario-1144486311 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:14:53.884385 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-3b4eafd4-c28d-4b1b-ab1a-389eb2031a3b tempest-TestMinimumBasicScenario-1144486311 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:14:53.888826 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-3b4eafd4-c28d-4b1b-ab1a-389eb2031a3b tempest-TestMinimumBasicScenario-1144486311 None] Deleted volume successfully.
Jul 16 22:14:53.970958 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-3b4eafd4-c28d-4b1b-ab1a-389eb2031a3b tempest-TestMinimumBasicScenario-1144486311 None] Lock "cinder-36056bf8-8e40-4e6d-8dbd-37c6058c9b1f-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 22:15:17.277208 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=19,cinder:INSERT=2,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:15:27.262249 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=18,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:15:38.463554 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:15:38.464245 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:15:38.487628 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:15:38.514571 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:15:57.254052 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:16:07.259551 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:16:27.264685 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:16:38.460851 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:16:38.461439 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:16:38.493615 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:16:38.521916 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:16:47.260515 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:17:07.256109 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:17:27.257768 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:17:47.254918 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:18:07.255440 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:18:17.262080 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:18:38.458481 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:18:38.459240 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:18:38.485966 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:18:38.514615 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:18:47.258016 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:18:57.261138 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:19:17.264448 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:19:37.263325 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:19:38.460820 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:19:38.461422 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:19:38.487167 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:19:38.511212 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:19:47.269316 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:20:17.273310 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:20:17.274980 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:20:37.274742 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:20:38.456512 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:20:38.457221 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:20:38.479963 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:20:38.504120 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:20:57.280370 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:21:17.287712 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:21:37.281138 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:21:38.460272 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:21:38.460901 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:21:38.485122 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:21:38.508358 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:21:47.288752 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:21:57.293301 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:22:27.283895 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:22:27.286275 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:22:38.463773 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:22:38.464462 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:22:38.500141 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:22:38.524865 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:23:07.276305 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:23:07.277197 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:23:17.347939 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:23:38.460520 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:23:38.461329 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:23:38.484013 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:23:38.507369 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:23:47.284101 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:23:47.285547 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:24:27.288946 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:24:27.290995 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:24:38.462877 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:24:38.463675 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:24:38.486335 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:24:38.511655 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:24:47.292041 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:25:07.297559 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:25:27.292500 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:25:38.466477 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:25:38.467252 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:25:38.490024 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:25:38.514900 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:25:47.286029 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:26:07.277518 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:26:27.275418 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:26:38.471264 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:26:38.471950 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:26:38.494843 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:26:38.519534 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:26:47.273491 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:27:07.272531 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:27:27.265090 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:27:38.306324 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:27:38.351917 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131857) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Jul 16 22:27:38.371493 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Flow 'volume_create_manager' (5118bafc-bee3-4a2e-964b-1e86ec84a57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 22:27:38.377746 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a2977c-b6f5-49d3-9e05-3f7e61a1ff6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:27:38.394156 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a2977c-b6f5-49d3-9e05-3f7e61a1ff6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-07-16T22:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1409645389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=51002b9e-3891-4493-ad02-66fefc771dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d60fe3fdc841998824b803809f9e49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-16T22:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-16T22:27:38Z,use_quota=True,user_id='45b6f8ac55464fc99331221b6c67a85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee624004-17a5-4a84-bbc4-1f0262571bd8),volume_type_id=ee624004-17a5-4a84-bbc4-1f0262571bd8)' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:27:38.400199 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806db479-bf03-4758-8b17-922b739241e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:27:38.404222 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806db479-bf03-4758-8b17-922b739241e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:27:38.409154 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633d6307-1a30-421a-8413-6a906aeb4378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:27:38.474557 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:27:38.478039 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:27:38.498037 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:27:38.521424 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:27:38.540142 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633d6307-1a30-421a-8413-6a906aeb4378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '51002b9e-3891-4493-ad02-66fefc771dc2', 'volume_name': 'volume-51002b9e-3891-4493-ad02-66fefc771dc2', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958ef31d30>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:27:38.545053 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb7a3ab-6111-4088-991d-b95198c2281a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:27:38.548900 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb7a3ab-6111-4088-991d-b95198c2281a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:27:38.553682 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8036858-702c-4474-960b-315d312b7d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:27:38.555764 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Volume 51002b9e-3891-4493-ad02-66fefc771dc2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-51002b9e-3891-4493-ad02-66fefc771dc2', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958ef31d30>}
Jul 16 22:27:38.555764 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Cloning 51002b9e-3891-4493-ad02-66fefc771dc2 from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9  at location (None, None). {{(pid=131857) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Jul 16 22:27:38.556391 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Acquiring lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" by "_prepare_image_cache_entry" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 22:27:38.563923 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 22:27:38.657614 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 22, 27, 38, 568304)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 22:27:38.657988 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 22:27:38.658394 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Found cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Jul 16 22:27:38.662615 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Lock "cinder-1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9" released by "_prepare_image_cache_entry" :: held 0.099s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 22:27:38.663538 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Attempting to retrieve cache entry for image = 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 on host ncdv-master-1@ceph#ceph. {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Jul 16 22:27:38.674041 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Found image-volume cache entry: {'id': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'volume_id': 'b59b3901-b32a-4d92-81b0-6b99e88e4517', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54), 'last_used': datetime.datetime(2022, 7, 16, 22, 27, 38, 667662)}. {{(pid=131857) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Jul 16 22:27:38.674041 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.image.cache [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Image-volume cache entry image_update_at = 2022-07-16 20:58:54+00:00, requested image updated_at = 2022-07-16 20:58:54+00:00. {{(pid=131857) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Jul 16 22:27:38.674041 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Creating from source image-volume b59b3901-b32a-4d92-81b0-6b99e88e4517 {{(pid=131857) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Jul 16 22:27:38.684493 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:27:38.800241 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] creating snapshot='volume-51002b9e-3891-4493-ad02-66fefc771dc2.clone_snap' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Jul 16 22:27:39.841292 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] cloning 'volume-b59b3901-b32a-4d92-81b0-6b99e88e4517@volume-51002b9e-3891-4493-ad02-66fefc771dc2.clone_snap' to 'volume-51002b9e-3891-4493-ad02-66fefc771dc2' {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Jul 16 22:27:40.335124 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Volume volume-eb5651c9-06af-46c0-905c-8ecec06e7945.deleted is not a clone. {{(pid=131857) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Jul 16 22:27:40.336311 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Jul 16 22:27:40.336692 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131857) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Jul 16 22:27:40.509207 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] clone created successfully {{(pid=131857) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Jul 16 22:27:40.509778 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.volume_utils [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Marking volume 51002b9e-3891-4493-ad02-66fefc771dc2 as bootable. {{(pid=131857) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}}
Jul 16 22:27:40.560883 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Copying metadata from image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 to 51002b9e-3891-4493-ad02-66fefc771dc2. {{(pid=131857) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Jul 16 22:27:40.561316 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.flows.manager.create_volume [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Creating volume glance metadata for volume 51002b9e-3891-4493-ad02-66fefc771dc2 backed by image 1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131857) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Jul 16 22:27:40.667834 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8036858-702c-4474-960b-315d312b7d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51002b9e-3891-4493-ad02-66fefc771dc2', 'volume_size': 1, 'image_id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '455f5961d0804544b3b78f843a889637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9', 'created_at': datetime.datetime(2022, 7, 16, 20, 58, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 16, 20, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bb9fddd-5eec-4ac9-86bd-3afdc2144cb9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f958ef31d30>}' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:27:40.677762 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12492cad-e011-4a17-afe0-9bbe5ee04c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Jul 16 22:27:40.755906 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.flows.manager.create_volume [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Volume volume-51002b9e-3891-4493-ad02-66fefc771dc2 (51002b9e-3891-4493-ad02-66fefc771dc2): created successfully
Jul 16 22:27:40.759620 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12492cad-e011-4a17-afe0-9bbe5ee04c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131857) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Jul 16 22:27:40.764971 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Flow 'volume_create_manager' (5118bafc-bee3-4a2e-964b-1e86ec84a57f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131857) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Jul 16 22:27:40.812312 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [None req-08985eff-6301-4319-a13e-c3492d85b173 tempest-TestShelveInstance-574938005 None] Created volume successfully.
Jul 16 22:27:44.443540 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-f6a519c7-c13a-4881-abac-6d623af8b809 req-317b882d-3f90-4569-a859-5fcb256ae5fc tempest-TestShelveInstance-574938005 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 16 22:27:45.467950 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_concurrency.processutils [req-f6a519c7-c13a-4881-abac-6d623af8b809 req-317b882d-3f90-4569-a859-5fcb256ae5fc tempest-TestShelveInstance-574938005 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.024s {{(pid=131857) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 16 22:27:45.468763 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-f6a519c7-c13a-4881-abac-6d623af8b809 req-317b882d-3f90-4569-a859-5fcb256ae5fc tempest-TestShelveInstance-574938005 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-51002b9e-3891-4493-ad02-66fefc771dc2', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '314f633c-a190-4b43-bf64-3306a55ebc3e', 'volume_id': '51002b9e-3891-4493-ad02-66fefc771dc2', 'discard': True}} {{(pid=131857) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Jul 16 22:27:45.584385 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-f6a519c7-c13a-4881-abac-6d623af8b809 req-317b882d-3f90-4569-a859-5fcb256ae5fc tempest-TestShelveInstance-574938005 None] Connection info returned from driver {'name': 'volumes/volume-51002b9e-3891-4493-ad02-66fefc771dc2', 'hosts': ['10.222.0.16'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '51002b9e-3891-4493-ad02-66fefc771dc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '12c44da5-207e-4c89-939e-22018623e040'} {{(pid=131857) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}}
Jul 16 22:27:45.740766 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-f6a519c7-c13a-4881-abac-6d623af8b809 req-317b882d-3f90-4569-a859-5fcb256ae5fc tempest-TestShelveInstance-574938005 None] attachment_update completed successfully.
Jul 16 22:28:07.258029 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=33,cinder:UPDATE=6,cinder:INSERT=11 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:28:17.254708 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=28,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:28:27.264044 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:28:38.470938 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:28:38.471857 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:28:38.508868 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:28:38.534377 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:28:47.264209 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:29:07.262492 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:29:27.276612 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:29:38.469937 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:29:38.470616 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:29:38.494016 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:29:38.519414 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:29:47.267419 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:30:07.275262 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:30:27.276958 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:30:38.474217 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:30:38.474899 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:30:38.500538 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:30:38.524909 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:30:47.277401 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:31:07.278793 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:31:27.277466 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:31:32.740526 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-1fdca95d-8a4d-4cce-8566-496a0503a41f req-a9c5bb2d-e8c7-4030-b627-6279477259e5 tempest-TestShelveInstance-574938005 None] Terminate volume connection completed successfully.
Jul 16 22:31:32.741152 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.manager [req-1fdca95d-8a4d-4cce-8566-496a0503a41f req-a9c5bb2d-e8c7-4030-b627-6279477259e5 tempest-TestShelveInstance-574938005 None] Deleting attachment 12c44da5-207e-4c89-939e-22018623e040. {{(pid=131857) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}}
Jul 16 22:31:33.055489 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-1fdca95d-8a4d-4cce-8566-496a0503a41f req-45b51f87-9a23-47b3-9066-f8af42a7820d tempest-TestShelveInstance-574938005 None] Acquiring lock "cinder-51002b9e-3891-4493-ad02-66fefc771dc2-delete_volume" by "delete_volume" {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Jul 16 22:31:33.064908 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-1fdca95d-8a4d-4cce-8566-496a0503a41f req-45b51f87-9a23-47b3-9066-f8af42a7820d tempest-TestShelveInstance-574938005 None] Lock "cinder-51002b9e-3891-4493-ad02-66fefc771dc2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Jul 16 22:31:33.145420 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-1fdca95d-8a4d-4cce-8566-496a0503a41f req-45b51f87-9a23-47b3-9066-f8af42a7820d tempest-TestShelveInstance-574938005 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:31:33.292124 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-1fdca95d-8a4d-4cce-8566-496a0503a41f req-45b51f87-9a23-47b3-9066-f8af42a7820d tempest-TestShelveInstance-574938005 None] volume has no backup snaps {{(pid=131857) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Jul 16 22:31:33.381392 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-1fdca95d-8a4d-4cce-8566-496a0503a41f req-45b51f87-9a23-47b3-9066-f8af42a7820d tempest-TestShelveInstance-574938005 None] deleting rbd volume volume-51002b9e-3891-4493-ad02-66fefc771dc2 {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Jul 16 22:31:36.472806 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-1fdca95d-8a4d-4cce-8566-496a0503a41f req-45b51f87-9a23-47b3-9066-f8af42a7820d tempest-TestShelveInstance-574938005 None] volume is a clone so cleaning references {{(pid=131857) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Jul 16 22:31:36.558196 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-1fdca95d-8a4d-4cce-8566-496a0503a41f req-45b51f87-9a23-47b3-9066-f8af42a7820d tempest-TestShelveInstance-574938005 None] deleting parent snapshot volume-51002b9e-3891-4493-ad02-66fefc771dc2.clone_snap {{(pid=131857) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Jul 16 22:31:38.919429 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:31:38.920099 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:31:38.983551 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:31:39.042214 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:31:39.054389 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:31:39.144350 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.quota [req-1fdca95d-8a4d-4cce-8566-496a0503a41f req-45b51f87-9a23-47b3-9066-f8af42a7820d tempest-TestShelveInstance-574938005 None] Created reservations ['01c4499c-6d08-45d9-b4fa-5ab76b085e64', 'fd0bfc22-00cc-4dc3-8b3d-fde56c87344b', 'a6e8aee6-66df-4e93-893b-3b6e4c81737f', 'db9452ce-fbe4-4f30-ac3e-667f2c3ee2c4'] {{(pid=131857) reserve /opt/stack/cinder/cinder/quota.py:755}}
Jul 16 22:31:39.321942 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-1fdca95d-8a4d-4cce-8566-496a0503a41f req-45b51f87-9a23-47b3-9066-f8af42a7820d tempest-TestShelveInstance-574938005 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:31:39.355432 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [req-1fdca95d-8a4d-4cce-8566-496a0503a41f req-45b51f87-9a23-47b3-9066-f8af42a7820d tempest-TestShelveInstance-574938005 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:31:39.381736 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [req-1fdca95d-8a4d-4cce-8566-496a0503a41f req-45b51f87-9a23-47b3-9066-f8af42a7820d tempest-TestShelveInstance-574938005 None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:31:39.386038 ncdv-master-1 cinder-volume[131857]: INFO cinder.volume.manager [req-1fdca95d-8a4d-4cce-8566-496a0503a41f req-45b51f87-9a23-47b3-9066-f8af42a7820d tempest-TestShelveInstance-574938005 None] Deleted volume successfully.
Jul 16 22:31:39.468990 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.coordination [req-1fdca95d-8a4d-4cce-8566-496a0503a41f req-45b51f87-9a23-47b3-9066-f8af42a7820d tempest-TestShelveInstance-574938005 None] Lock "cinder-51002b9e-3891-4493-ad02-66fefc771dc2-delete_volume" released by "delete_volume" :: held 6.405s {{(pid=131857) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Jul 16 22:31:58.919437 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=27,cinder:UPDATE=15,cinder:INSERT=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:32:18.919786 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:32:38.918057 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:32:38.922078 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:32:38.923065 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:32:38.946910 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:32:38.970257 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:32:58.915766 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:33:18.921705 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:33:38.925981 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:33:38.926596 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:33:38.949766 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:33:38.972504 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:33:38.976679 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:33:38.982428 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:34:08.926185 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:34:18.930415 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:34:38.925584 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:34:38.926451 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:34:38.960657 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:34:38.987368 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:34:38.991406 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:34:38.992021 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:35:08.999602 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:35:18.997549 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:35:38.929997 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:35:38.930650 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:35:38.953781 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:35:38.978843 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:35:48.997407 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:35:58.993571 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:36:18.994719 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:36:38.934717 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:36:38.935437 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:36:38.960793 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:36:38.989849 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:36:38.997687 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:36:39.010397 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:37:08.999951 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:37:19.005174 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:37:38.935355 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:37:38.936131 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:37:38.959680 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:37:38.983439 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:37:39.008692 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:37:59.011625 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:38:19.000153 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:38:38.938887 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:38:38.939662 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:38:38.963890 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:38:38.987313 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:38:39.003361 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:38:59.002104 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:39:19.016159 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:39:38.942503 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:39:38.943192 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:39:38.966520 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:39:38.992012 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:39:39.011817 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:39:49.020114 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:40:09.012929 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:40:19.015738 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:40:38.947564 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:40:38.949110 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:40:38.971026 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:40:38.995137 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:40:49.015364 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:40:59.107772 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:41:19.031983 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:41:38.950716 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:41:38.951425 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:41:38.974900 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:41:39.002259 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:41:39.027935 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:41:59.031782 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:42:19.034278 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:42:29.031609 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:42:38.948421 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:42:38.949116 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:42:38.971585 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:42:38.995565 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:42:59.032642 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:42:59.035070 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:43:19.033469 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:43:38.951027 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:43:38.951705 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:43:39.026822 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:43:39.052658 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:43:39.059222 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:43:39.059956 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:43:59.069044 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:44:19.075947 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=2 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:44:19.076651 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Jul 16 22:44:38.952573 ncdv-master-1 cinder-volume[131857]: DEBUG oslo_service.periodic_task [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131857) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Jul 16 22:44:38.953317 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:44:38.977037 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.volume.drivers.rbd [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131857) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Jul 16 22:44:38.999889 ncdv-master-1 cinder-volume[131857]: DEBUG cinder.manager [None req-58b2f30f-8db6-4d06-b67d-c1a8d463f103 None None] Notifying Schedulers of capabilities ... {{(pid=131857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 16 22:44:49.080537 ncdv-master-1 cinder-volume[131857]: DEBUG dbcounter [-] [131857] Writing DB stats cinder:SELECT=3 {{(pid=131857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}